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ABSTRACT 



This study addresses a substantive and a methodological question. 
The substantive question 1s concerned with describing the content of 
the EFUC data base for five equity groups Including the physically 
Jnd the mentally handicapped. Blacks, Hispanics, and women. The 
methodological question is how much can be learned if the analysis is 
confined to exami nation of citations and abstracts rather than to 
examination of the literature Itself. Although questions of adequacy 
or relevance are not addressed, the study does provide much detail 
regarding the structural characteristics of the ERIC journal and 
document 1 iterature, e.g. , how much 1 iterature is there, both in 
terms of articles/documents and In terms of pages; what kinds and 
quantities of publications are represented, what types of agencies 
have sponsored the work; where was It performed; has the collection 
changed In character over time; does the literature that focuses on 
one equity group differ from the literature that focuses on another 
equity group; if so, in what ways. 

Posting data for the total journal collection (CLIE) and the total 
docLfment collection (RI E) are examined for each oFthe five equity 
groups, and also for combinations of groups with each of four broad 
topical areas (attitudes, employment, counseling, and curriculum). 
Then for each of the twenty group/topic combinations, samples of QIJE 
and RIE entries were selected and content analyzed in terms of a 
number of classifications, e.g., date of publication, page length, 
sex of author, sponsor. Comparisons among the five equity groups 
are made on each content analysis dimension for both the CUE and 
the £I£ samples. The £IE data are also examined in terms of cross 
classifications of all pairs of content dimensions (i.e., groups, 
topics, publication date, sponsor, performing Institution, type of 
publication, copy availability, authorship, number of equity groups 
identified, page length). This analysis demonstrates that there are 
a very large number of significant relationships among the dimensions. 

The stucjy also conclusively demonstrates that the literature posted 
to each of the five groups is significantly different in terms of 
most of the content analysis categories. 
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FOREWORD 



The Educational Dissemination Studies Program (EDSP) has three general 
objectives: 1) to establish efficient means for analyzing and com- 
municating the status, needs, and accomplishments of educational 
dissemination performers; 2) to Increase the quantity of, and access 
to knowledge pertaining to the educational dissemination process; and 
3) to establish a capacity for organizing and conducting special 
studies contributing to the Improvement of educational dissemination 
as a regional and nationwide effort. 

This report Is one of a series of EDSP special studies concerned with 
conceptualization and exploration of Information equity Issues In edu- 
cation. This series of equity studies began in the Summer of 1978 
with a mini-conference held at the Far West Laboratory. Representa- 
tives of women's, various minority and ethnic groups, the physically 
handicapped, and the geographically Isolated made presentations 
describing information needs, barriers, and problems confronted by 
the various groups. Subsequent to the conference. Dr. William Paisley, 
Institute for Communication Research, Stanford University, and Ms. Mary 
Kathryn Cirksena and Or. Matilda Butler, both of the Women's Educational 
Equity Communications Network, Far West Laboratory, completed two pilot 
studies. In one study, they examined the geographic distribution of 
information programs throughout the U.S. by aggregating selected data 
on information programs, ERIC collections, location of information 
users, and other demographic indicators at the level of 251 Standard 
Metropolitan Statistical Areas (SMSAs) and 334 SMSA/Rural Areas. Cross 
tabulation and multiple correlation analyses of these data demonstrated 
that resources such as information programs and ERIC collections are 
not equitably distributed throughout the United States. 

In the second study, they examined the ERIC data base coverage for 
five equity groups in each of eight substantive areas to determine the 
total nurnber of documents/articles available for each group by substaiv 
tive area. This analysis demonstrated that there are Targe differences 
among the groups in the coverage of various topics and suggested the 
possibility that the literature pertaining to some groups may have less 
depth and breadth, document for document, than literature pertaining 
to other groups. 

On the basis of this exploratory work, EDSP proposed a set of four 
interrelated strands of study activity: 1) analyzing the conceptual 
and policy issues imp]ied by information equity; 2) conducting more 
detailed analysis of the documentary knowledge base; 3) developing 
statistical data on geographic distribution of Indicators of knowledge 
production, dissemination, and utilization; and 4) collecting case 
studies and other information describing the needs/uses of information 
by specific equity groups. 

Glen Harvey (1980) addressed the first strand with a major conceptual 
analysis in four sections. Part I analyzes the concepts of equality 
and equity, and identifies the possible interpretation attributed to 



ERLC 



XI 



10 



each* Part 11 analyzes Information equity, focusing on the clarifi- 
cation of Information-related concepts and the synthesis of these 
concepts with various equality and equity Interpretations* Part III 
enumerates and explains the more practically oriented issues involving 
Information equity policy decisions and indicates the connection 
between conceptual and practical considerations* Part IV discusses 
general policy recommendations, Indicating the direction In which 
Information equity policy statements and programs should proceed and 
suggesting the goals for which to aim* 

The current report is concerned v/ith the second strand of study 
activities--conducting more detailed analysis of the documentary 
kno\/ledge base* 
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K EXECUTIVE SUMMARV 



A* Introduction 

Information equity Is concerned with the equity of opportunity to 
obtain and use information* In the field of education* there are many 
groups Including racial and ethnic minorities, physically and mentally 
disabled, migrant and rural populations* Institutionalized populations* 
low income groups* women, non-English speaking Immigrants, and others 
who may encounter severe problenis 1n finding* understanding* and using 
educational Information they may need* Along a continuum of informa- 
tion service opportunity* shortcomings can be traced to inavailability 
of relevant information in the knowledge base; a lack of derivative 
information products; limited arrangements for distribution or provi- 
sion of personal services; and ultimately to lack of skill* experience* 
training or incentives on the part of Information users* This study 
focuses on aspects of the first part of this continuum* The major pur- 
pose of the study is to discover what simple levels of content analysis 
of citations and abstracts can tell us about the content of education's 
largest single data base, ERIC* with respect to five selected equity 
groups* 

The study does not deal with questions concerning the quality or rele- 
vance of the ERIC literature* but rather with questions concerning the 
structural characteristics of the literature* e*g*, how much literature 
is there; what kind and quantities of publications are represented; 
who has sponsored the work; where was it performed; has the collection 
changed in character over time; does the literature that focuses on 
one equity group differ from the literature that focuses on another 
equity group; if so, in what ways; do time trends or group differences 
have implications for ERIC acquisition or processing policy* etc* 



B* Design of the Study 

Results of a previous exploratory study were used to select five 
equity groups (physically handicapped* mentally handicapped* Blacks* 
Hispanics, and women) and four topical areas (attitudes, employment* 
counseling, and curriculum)* A multi-hour search of the data base 
using the DIALOG computer system was made to obtain counts and complete 
accession number listings of all documents/articles for each of the 
twenty combinations of five groups and four topics* Systematic satn- 
pies of journal articles indexed in the Current Index to Journals in 
Education ( CUE ) and of documents indexed in Research in Education 
( RIL J were then drawn from each of the twenty group/topic CUE and RI E 
accession listings* Five hundred RI£ entries and 483 CUE entries 
were Included in the total sample* 

The CU_E entries were classified by topic* group* year of publication, 
number of pages, journal title* and ERIC Clearinghous that made the 
accession* piE entires were classified by topic* group, year of 
publication, nuirtber of pages, type of publication, type of sponsor 
type of performing agency* state location, microfiche and hard copy 
availability* sex of author, and number of equity groups identified* 
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C* CPIO Data Base Coverage Summary 

Ry the Spring of 1980, the ERIC data base exceeded three hundred and 
ninety thousand articles/documents* A total of over thirty-four 
thousand postings In the data base were made to the five equity groups 
considered in the study: women, 16,573 articles/documents; Blacks 
6,327; Hispanics, 3,603; mentally handicapped, 5,920; and physically 
handicapped, 1,486* Four substantive topics were searched for each of 
these five groups* Thfi topics of attitudes, employment^ and counseling 
were selected because a previous study indicated that literature on 
the5e topics tended to be more frequently Indexed to special groups* 
A fourth topic, curriculum^ was selected as representative of topics 
which are less often Indexed to special groups* Although there were 
several differences between the special groups searched in the pre- 
liminary study and the current study, this pattern of topical over^ 
and under-posting for special groups was confirmed for both the CUE 
article and the RIE document literature* For all ERIC literature 
( CUE plus RIE ) , the percentage of the postings to the five groups Is 
approximateTy^twice as high for attitude topics (18*8% vs* 9*5%) and 
for employment topics (9*2% vs* 4*3%), and half as high for curriculum 
topics (4*9% vs* 10*3%) when compared to the percentage of postings to 
topics for all ERIC articles/documents* Although the difference in 
percentages (6*0% vs* 4*6%) is less for the counseling topic. It Is 
in the predicted direction of higher percentage of postings for the 
special groups* 

Although only four of potentially hundreds of topics were examined, 
it is evident that these four account for sizable proportions of the 
literature posted to the five groups^ amounting to nearly a third of 
the sum of the postings for the five groups for q^JE articles and 
nearly half of the group postings for RIE documents* 

There are remarkable differences between the CUE and RIE literature 
in the amounts and proportions of the literature posted to topics and 
to groups* In numbers and in percentages^ there are substantially 
more postings to curriculum and to employment topics in RIE than in 
CUE * There are also remarkably higher numbers and percentages of 
postings to Hispanics and Blacks in £IE than in q^JE * However, the 
number of postings to mentally handicapped is significantly less in 
RIE than in CUE* 

Aside from the general tendency for most groups to receive more post- 
ings for attitude, employment, and occasionally counseling topics, 
and to receive fewer postings for curriculum topics, there are few 
similarities but many differences among the five groups* These dif- 
ferences are especially marked when internal comparisons are made 
among individual postings for the twenty combinations of five groups 
and four topics* Chi square tests of independence (between groups 
and topics)were highly significant for both the CUE and RIE postings, 
with 12 of the 20 cells in the CUE analysis ancTTT'of theTO cells 
in the RI£ analysis displaying highly significant discrepancies 
between expected and actual numbers of postings* Although there are 
gross similarities between the QUE and the JRI£ chi square analyses 
(thirteen of the twenty corresponding pairs of topic/group cells were 
either both insignificant or were both significant and with the same 
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sign), there are no very striking patterns of similarity among groups 
or among topics in the actual /expected frequency discrepancy patterns 
for either CUE or RI E, We are thus forced to conclude that generali- 
zations from one to another equity group in terms of the amounts or 
proportions of CjJE, or RIE postings to various topics, or from one 
topic to another topic In terms of proportions of postings to various 
groups can be made only very roughly, and with many errors^ 



D, SufTmary of CUE Content Analysis 

The CUE journal samples display significant group or topic differ^ 
ences in every area we examined, namely: average date of publication, 
average page length, number of journal titles represented in the sam- 
ples, sample circulation size, and clearinghouse distribution. 

With publication dates ranging from 1969 to 1979, the average CUE 
article In the total sample Is early 1974; however, the publication 
date averages for women and for physically handicapped are at least 
a year more recent than the averages of the other three groups. Over- 
all, CUE articles average approximately seven pages in length. How- 
ever the articles for both handicapped groups average less than six 
pages, while those for Hispanics and women average over eight pages. 
Articles on counseling topics average approximately six pages, but 
those for employment topics average over eight pages. 

There are substantial differences in how many Journals are represented 
In these samples and also in how widely they are circulated. General- 
ly, the Journal literature in the field of education Is highly dis- 
persed. This is certainly true for most of these group/topic samples. 
The 483 CUE articles included In this study were found In over two 
hundred different Journals. Typically, one would need to subscribe to 
six or seven Journals pe r group/topic combination in order to find 
even half the articles in each sample of 25 articles. However there 
Is a wide range (2 to 13 journal titles) to achieve ''50% coverage." 
To cover all 25 articles In each group/topic sample, one must consult 
8 to 25 different Journals. There are also vast differences In circu- 
lation size. A significant topic by group Interaction effect makes It 
difficult to generalize concerning overall circulation or concerning 
differences among topic or among groups. Moreover, the extreme dif- 
ferences among circulation figures for individual journals {500 to 
1,800,000) tend to seriously distort the arithmetic averages. Median 
circulations for the 20 topic/group samples range from 2,500 to 24,000, 
Indicating that there are vastly different levels of circulation. 

Given the specialization of the ERIC clearinghouses, and the specific 
topics and groups that were considered In these CUE samples, it comes 
as no surprise to find greatly different proportional contributions. 
In fact two-thirds of the total sample of articles were processed by 
only four clearinghouses, but all sixteen clearinghouses are repre- 
sented in the sample. Despite the heavy concentration In a few 
clearinghouses, it is noted that in only one group (the physically 
handicapped) and in only one topical area (counseling) does a single 
clearinghouse process as much as half the articles Included in these 
sampl es. 



E. SuTiniary of RIE Content Analysis Results for Group Differences 

Recouse many more variables were coded in the content analysis of 
Research in Education (RIE) documents, the results of the RIJ^ analy- 
sis are much more extensive than those summarized in the previous 
section on CUE articles. The analysis shows that the samples of 
RIE documents for the five equity groups are significantly different 
"along a number of dimensions including; average age of the literature, 
sponsorship, type of institutional performer, type of document, author^ 
ship, and single/multiple equity group focus of the documents* contents. 
Only two characteristics showed no difference among groups; average 
page length and availabiity in microfiche or hardcopy. 

As of early 1980, the average publication date for the RXE documents 
in these samples was early 1972, but the women's literature have a 
significantly more recent average (early 1974), while the mentally 
handicapped average is significantly earlier (late 1970). The average 
length for all £I£ documents in the sample is 107 pages. There are no 
differences for groups; however, document length does vary with topic, 
with an average of 83 pages for attitude topics and 132 pages for 
employment topics. 

Who sponsors the work reported in RIE documents, which types of insti- 
tutions perform the work, and what types of publications/formats it 
appears in, all vary significantly over the five groups. Overall, 
more than forty percent of the sample was federally sponsored, and 
federal, state, and local agencies together account for 55 percent of 
all documents. There are several differences among the samples of the 
five groups, e.g., a significantly higher proportion of documents in 
the women's sample are produced by university based authors; a larger 
than expected amount of the physically handicapped samples are pro- 
duced by noi>profit/for-profit agencies; and publishers are notable 
contributors to the mentally handicapped sample. RI£ contains a wide 
variety of types of documents. When classified by eight specific and 
one miscellaneous classifications, we find that over one-fourth of the 
documents are research reports. Research reports, project descriptions, 
and speeches constitute sixty percent of the total sample of 500 RIE 
documents. There are several significant differences among the groups 
in the percentage of documents that are of one type or another. For 
example, the women's sample contains almost twice the percentage (37%) 
of research reports when compared to the physically handicapped (20%). 
There are no overall differences among the five groups in availability 
in either microfiche or hardcopy forms. Over three- fourths of the 
sample can be ordered from central facilities (e.g., EDRS, NTIS) in 
full-size hardcopy, and frcwn 80 to 90 percent of the samples for the 
five groups are available in microfiche. 

The samples of documents for the five groups differ in their author 
identification, with substantially more individual authors for the 
women and Black samples, and a larger percentage of corporate (anony- 
mous) authorship for the handicapped. There is a complete sex reversal 
in the authorship of women's documents as compared to the other four 
groups. While 64 percent of the first authors of the women's samples 
are female, 67 to 71 percent of the first authors in the other four 
samples are male. Finally, there are some substantial differences 



among the five groups fn the singularity of focus of their document 
literature. For example, nearly two-thirds of the samples for mentally 
handicapped and women {65% and 61% re$pective]y) focus e)cc]usively on 
those groups* while only one-third (32%) of the physically handicapped 
sample deals exclusively with that group* 



F. Summary of the Analysis of Interrelationships Among Other RIE 
Content Analysts Variable^ 

All of the variables employed in the RIE content analysis display sig- 
nificant relations with some, often with most of the other variables. 
Indeed, the relationships are so numerous and complex that it soon 
becomes obvious why there are few, if any, broad generalizations that 
one can make from one equity group sample to another. There is clear 
evidence that the JRIE data base has changed in composition over time, 
in the amount of 1 iterature indexed to various equity groups, and in 
the proportions of types of documents accessed, type of sponsorship 
represented, type of institutional performers, in the availability of 
documents, and even in the proportions of documents authored by women 
first (and second) authors. Type of document is a highly significant 
variable that is complexly related to type of sponsor and type of 
performer* Proportions of all three types have changed over time, 
and are proportionally different in many equity group* topic, and 
other types of cross classifications. Although the many significant 
interrelationships among variables seem to preclude finding simple 
relationships, they also point to a number of methodological refine- 
ments that could make futures studies of the ERIC data base more 
efficient and informative* 



G. Concl usions 

A few of the most significant conclusions are these: 

1* The literature for the five equity groups is different along 
many dimensions including sheer quantity, proportions found in CUE 
and RIE» average age, type of publication, sponsorship* performer 
institution, authorship, page length* etc* The differences are so 
marVi and in some cases so large, that each equity group must be 
examined separately, rather than generalizing from one group to 
another* Given these results, there seems to be no firm basis for 
predicting accurately what the literature for other equity groups may 
look like except in the grossest terms. Until one can show that there 
are, in fact* few important differences in the content of the litera- 
ture for two or more equity groups, the most prudent course of action 
may be to assume that the ERIC literature for each group is different 
until it has been proven otherwise. On the other hand, this study has 
demonstrated that samples as small as one hundred articles/documents 
per group m^ be sufficient to provide a general profile that can be 
compared with the data for the five groups examined in this report* 



2. Altliough comparisons can be attempted based on randOdi samples 
of all the literature posted to equity groups, this study has amply 
demonstrated that controlling for topic is desirable, if not essential. 
The data pertaining to specific group/topic combinations is frequently 
significantly different from the data found for other topics posted 

to the same equity group or for othet^ equity groups posted to the 
same topic. 

3. Although some very general similarities 1n proportions of 
postings to groups and to topics were found when canparing CUE and 
RIE , there are a number of remarkable differences, e.g., in terms of 
numbers and of proportions of postings, RIE is more prone to contain 
documents posted to equity groups than is CIJE . 



4. There is evidence that both CIJE and RIE postings have changed 
over time. From an equity point of view, most of the evidence is 
positive. One of the simplest, but starkly compelling findings is 
that the proportion of female authors has risen markedly over a fif- 
teen year period. From a technical point of view, it may be important 
to know that there are many significant time trend differences in types 
of documents accessed, in types of sponsors, and in types of performers. 
This is particularly true for RIE . Searches that focus on the more 
recent literature will find a different literature than will be found 

if the entire data base is searched, e.g., more speeches, more federally 
sponsored reports, "more university produced documents, mor? documents 
that can be obtained in hard copy, more documents authored by women. 

5. Although the quite recent incorporation of publication codes 
in RIE entries makes it impossible to employ this classification in 
retrospective searches that go back more than a year or two, this 
study has amply demonstrated the need to take publication type into 
account in any comparative analysis. The publication type classifi- 
cation was significantly related to every other variable considered 
in the RIE content analysis. The publication codes will be highly 
valuable tools for search and for analysis uses. 

6. It must be emphasized that this study provides no data on 
how good^ how adequate, or how relevant the ERIC literature may be. 
However, It does provide a detailed analysis of how the ERIC literature 
Is structured for five significant equity groups. 
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II. INTRODUCTION 



A. Information Equity and the Knowledge Base 

The term ''Information equity** is new to the field of dissemination 
and information science. It seems to have been coined as the tH1e 
of d mini -conference held under National Institute of Education 
sponsorship at the Far West Laboratory in the summer of 1978. The 
following winter, a national conference on information equity was 
held in Washington, DC, again under NIE sponsorship. In a paper 
presented at the Washington conference. Paisley, Cirksena, and 
Butler noted that in the "knowledge society" of contemporary America, 
resources and power accrue to those who have information, and that 
information accrues to those who have resources and power. This 
circle of cause and effect, especially with the introduction of new 
information technology, has tended to widen the gap between informa- 
tion "haves" and "have-nots*" Information equity is concerned with 
the equity of opportunity to obtain and use information. Along a 
continuum of information service opportunity, shortcomings can be 
traced to inavailability of relevant information in the knowledge 
base; a lack of derivative information products; limited arrangements 
for distribution or interpersonal services; and, finally, to lack of 
skill, experience, training, or incentives on the part of users* 
While other EDSP information equity studies will address later por- 
tions of this continuum, this study focuses on aspects of the first 
part of this continuum— a question of what is in the knowledge base. 
This study does not address the difficult question of "relevance." 
Rather, its immediate concern is to discover what simple levels of 
content analysis of citations and abstracts can tell us about the 
content of education's largest single data base, the ERIC data base, 
with respect to selected equity groups. This study does not deal 
with questions concerning how good or relevant this literature might 
be with respect to some set of information needs, but rather with 
questions about the content of the literature per se , e.g.: how 
much literature is there; what kinds of publications are represented; 
who has sponsored the work; where was it performed; has the collection 
changed in character over time; does the literature that focuses on 
one equity group differ from the literature that focuses on another 
group; if so, in what ways; do these time trends or group differences 
have implications for ERIC acquisition policy, etc. 



B. Review of the Previous EDSP Study of the ERIC Data Base 

In a previous exploratory study of the ERIC data base (Paisley, 
Cirksena, and Butler, 1979) postings for five broad groups-emigrant 
populations, rural populations, women, the disabled, and racial/ethnic 
minorities—were examined for the entire data base, and fnore speci- 
fically in terms of eight broad topics— ability, learning, instruction, 
curriculum, counseling, attitudes, administration, and employment. 
Over 50 thousand postings to the five groups were found: about 15 
thousand documents/articles each for women, the disabled, and racial/ 
ethnic minorities; 7 thousand for rural populations, and a thousand 



|er|c 



for migrant populations. The number of postings by topic across the 
five groups ranged from a low of 1,870 for administration to 5,666 
for instruction, with a total of 35 thousand postings for the eight 
topics. Comparisons across groups revealed different proportions 
of postings by topics. For example, more than one-third of all ERIC 
postings for the disabled are accounted for by just the three topics 
of ability, learning, and instruction, while less than one-sixth of 
all postings for women involve these topics. 

At the level of specific group-by-topic combinations, there were many 
posting counts that deviated markedly from their "expected frequencies," 
computed on the basis of proportions of topic and group postings for 
the total ERIC data base. For example, over three thousand articles/ 
documents were found dealing with attitudes/women when only two thou- 
sand were expected. Conversely, only 256 articles/documents were 
found dealing with learning/rural when 570 would be expected. {See 
Appendix A for details of the study.) 

In concluding their report, the authors noted that as the preeminent 
data base In education, ERIC deserved further attention. Th^ noted 
that longitudinal trends would create a valuable third dimension, in 
addition to groups and topics* and that analysis of types of documents/ 
articles would Indicate needed gap-filling. The possibility that the 
literature pertaining to some groups may have less depth and breadth, 
document for document, than literature pertaining to other groups also 
needed exploration, as did the analysis of data bases beyond ERIC. 
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in. DESIGN AND CONDUCT OF THE FOLLOW-UP STUDY 



A. Selection of Categories and Sampling Method 

This follow-up study proceeds directly from the above recommendations 
(with the exception that the focus remains solely on ERIC). For this 
next step, it is necessary to go beyond posting counts to retrieve, 
code, and statistically analyze the content of ERIC citation/abstracts 
in terms of various characteristics (e.g., date of publication, number 
of pages, sponsorship, type of document). Since the information avail- 
able in Research in Education (RIE) regarding ERIC documents consis- 
tently includes citations and abstracts for each document, while that 
from the Current Index to Journals in Education ( CUE ) contains only 
citations in the earlier accessions but includes short abstracts of 
journal articles in later accessions, the RIE entries provided 
substantially more information that can be content analyzed than do 
the CIJE entries. Hence, separate studies of RIE and CUE were 
planned, but with a deliberate attempt to maintain as many comparable 
elements as possible. 

Because 35,000 postings were found in the previous study, with indi- 
vidual topic/equity group cell counts ranging from 46 to 3,207 items 
(see Appendix A, Table Al), some method of sampling would be needed 
in order to reduce the amount of work and still make useful compari- 
sons and estimates. To reduce the volume of work, it was also decided 
to examine only four of the eight topics, but to retain four or five 
groups. Examination of the discrepancies between actual and expected 
frequencies for the eight topics considered in the original study 
revealed that there were significantly higher tendencies for the top- 
ics of "attitudes," "employment," and ''counseling" to be associated 
with specific populations, while the literatures dealing with "learn- 
ing," "instruction," "curriculum," and "administration" were signifi- 
cantly less often associated with special groups (see Appendix A). 
"Ability" was the only topic where actual frequencies and expected 
frequencies were not significantly discrepant. We decided to retain 
all three of the "overexpectation" topics: "attitudes," "employment," 
and "counseling." Among the five other topics, we selected "curricu- 
lum," primarily because Its underrepresentation roughly balanced the 
average overrepresentation of the other three selected topics, but 
also because we expected this topical area to provide some sense of 
what teachers or students could lay their hands on in terms of learn- 
ing resources* 

Regarding the three "overexpectation" topics, we note in passing that 
the emergence of a distinct literature on attitudes of or toward a 
particular group is often one of the early indicators of the emergence 
of interest in that group. This is often followed by more specific 
concerns with counseling and employment. The ERIC employment litera^ 
ture, in particular, often reflects a broader area of social concern 
that involves mar\y non-educationa] sponsors and performers. 

Initially, we decided to look at the literature on these four topics 
for at least four special groups. After examining the ERIC descriptor 



terms that had been used in the earlier study, we concluded that 
several of the groups were too heterogeneous. This seemed especially 
true of the '^minorities" group that included 15 terms that combined 
Qiacks, Mexican Americans, Eskimos, Japanese, Filipino Americans, 
and others in one group. Because of their large percentage in U,S, 
school populations, and especially in the FWL region, we decided to 
look dt two minority groups: Blacks and Hispanics (Mexican Americans 
and Puerto Ricans). 

The "disabled" cluster was also a heterogeneous grouping of 1^ terms 
representing many different disabilities (e.g., deaf, blind, speech 
handicapped, retarded children)* Because disabilities pose special 
problems of considerable current interest for educators, we decided 
to focus on a pair of specific disability groups--the physically 
handicapped and the mentally handicapped/retarded. 

These choices provided two **pairs," one contrasting two minority 
groups, and one contrasting two disability groups. Finally, because 
they represent half the population (and are of interest to several 
equity projects at FhlL), we decided to also include women as a fifth 
group. After examining the 13 terms used in the original study, we 
decided to reduce this set to the ten most generic terms (e.g., work- 
ing women, mothers, females).' 

The listing of the ERIC search terms for the four topical areas and 
the five special populations can be found in Appendix A- 



B, Sampling 

As in the case of the previous study, another multi-hour search of 
the ERIC data base using the DIALOG system was made (in May igSO), 
But in this search we went beyond counts to obtain complete listings 
of all ED ( RIE ) and EJ ( CUE ) document numbers for each of the 20 
cells (four content topics by five special groups) of the study 
design- Each ED and each EJ listing for each cell was then syste- 
matically sampled to select exactly 25 items per listing-^ The 
selected ED item citations and abstracts were line printed, one to a 
page, directly from the Lockheed ERIC file. The selected EJ entries 
were located and copied manually from CUE volumes, and then mounted 
one to a page. 



^These choices meant that we dropped the "migrant" and "rural" groups 
from this exploratory analysis. Because both of these groups are of 
considerable interest, this was a hard choice that was reluctantly made 
in order to keep the present study of managable size and within budget. 
We intend to examine the literature on both of these groups, as well as 
other populations represented within the "minorities" and "disabled" 
categories in later studies, 

^Only eight EJ articles indexed by both curriculum and physically 
handicapped terms were found. All eight were included in the sample. 
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We note that there were two reasons for electing to use systematic 
sampling In preference to other sampling methods. First, this is the 
simplest way to sample the ED and EJ accession number listings. It 
is easily done manually, and on DIALOG it is possible to do it auto- 
matically through computer search codes. Of greater Importance was 
the desire to look at the longitudinal trends In accessions that 
Paisley, et al. had suggested would create a valuable third dimension. 
Systematic sampling results in equal numbers of items appearing 1n 
each accession segment. Because, accession numbers are highly corre- 
lated with date of publication^ obtaining equal numbers of documents 
throughout several accession segments provides more powerful tests 
of time/trend differences and more reliable estimates of trend param- 
eters than could be obtained by simple random sampling. 3 As we shall 
see, the hunch that there would be longitudinal trends was amply con- 
firmed. Sponsorship, type of performer, type of publication, degree 
of accessibility, author sex# and many other characteristics of ERIC 
data base have changed significantly over time. These differences 
would have been found by a simple random sampling* but they are more 
powerfully tested when there are equal or nearly equal numbers of 
documents in each accession-time segment. 



C. CUE Analysis 

Figure 1 presents a sample CUE main entry with annotation. As previ 
ously noted* short abstracts appear only in later CI JE entries. 

FIGURE 1 
SAMPLE CIJE MAIN ENTRY 



Mi)or«fidAHnof 
DMCrfptort 

<maiordescrt0tor3 
ar» starred) 

Mi)or and Minor 
ld«ntlllm 

<ma|orideatHters 
are staited) 



EJ 125445 RC503W7- 
Native Amcrtciii Ttchiik|ucs of Sttrvlval In the 

/"^ntryi-P^f ■ John A. indian Historian; vl ]ji4 - 
p3-n Dec ]^7&(R«pnm: UMl) 
. DtficWpiOfi: *AllicficaaJndiuiirf^^ 

Education: *Pood« InstniSnDiH^MS^j^^ 
^Outdoor Educatton; *Plant Identificatl 
♦Safety; Tices 
, identifiers: American Indian Education; *Sufvival 
Techniques 

Presenting a review orbasic infbnnation, this article pieseots 
the following: (I) buitding a shelter. <2> making a fire. 
(3) finding and keeping food, (4) safety and medicine, 
<5)orieAtatiantodifections»and(6) aiwintiavelingirilhe 
country, (RTS) 




^A technically attractive alternative to systematic sampling cf lists 
ordered by accession number would be to form several strata from the 
ordered accession lists, and randomly sample within each stratum. This 
approach* although more mechanically difficult* would produce somewhat 
less biased statistical estimates of means, variances, etc., but would 
require a prior decision on the number of strata to use. 

11^^ 



Each CUE main entry was coded by the following elements: 

1. Topic descriptor (Attitudes, Counseling, Curriculum, 
Employment}* 

2. Equity group descriptor (Physically Handicapped, 
Mentally Handicapped, Blacks, Hlspanics, Women). 

3. Accession order (numbered 1-25 in reverse order from 
most recent to earliest accession number). 

4. Clearinghouse (two leading letters in clearinghouse 
number. 

5. Year of publication {publication date). 

6. Pages. 

7. Journal title. 

Recalling that topic and equity group descriptors were used in the 
search that formed each topic/group cell, further efforts to analyze 
CIJE entries by other descriptors or identifiers were not made.* 

The topic and group codes, together with the accession order number, 
uniquely identify each item in the sample. Means and variances for 
year of publication and for nuirt^er of pages were computed within cells, 
and across topics and groups. Clearinghouse codes were tallied within 
cells and summed across topics and groups* Journal titles were also 
tallied within cells and summed across topics and groups. The journal 
titles were used to estimate two characteristics: a) the concentration 
of the sample literature (e.g., how mariy and which Journals tend to 
cover the literature in the sampled areas); and b) journal circulation 
(i.e., roughly how mariy copies of the articles in the sample were cir- 
culated—how wide is the potential readership/access approximately for 
the articles in the samples). Circulation figures for the 200 plus 
journals represented in the samples were sought from several sources. 
First, by examination of circulation data published in Ulrich's Inter - 
national Periodicals Directory (1979), then by examination of other 
sources, including Camp and Schwark's Guide to Periodicals in Education 
and Academic Disciplines (1975), Ayer Directory of Newspapers, Magazines, 
& Trade Publications (1978), and examination of circulation statements 
contained in issues of journals located in the FWL library, at San 
Mateo Education Resource Center, and at several ERIC Clearinghouses 
(see Acknowledgements). 



^ith cell samples of 25, cross classification along ary third 
descriptor classification dimension results in very low cross 
classification cell counts and very mariy zero counts, even if very 
large descriptor categories are used. Moreover, combining thousands 
of ERIC descriptor terms into a manageable nufri^er of classes is 
difficult logically and gargantuan technically. 

24 
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D. RIE Analysis 



While CUE focuses exclusively on journals In education* RIE Includes 
references to a much more diversified literature Including; books* 
curriculum materials, Instructional guides* project descriptions and 
evaluations, bibliographies and other reference materials* research 
reports* speeches and conference proceedings* theses* journal articles* 
and a number of other publication categories. Because of the diversity 
of these RIE entries, and due to the presence of suitable citation/ 
abstract Wormatlon* a inore detailed analysis of the ED citations/ 
abstracts was undertaken. Figure 2 presents a sample RIE entry. 



FIGURE 2 
SAMPLE RESUME ENTRY 



into. 




IMC . 

fto* HKonm AMii«Miify * MF 

matnt m)c*o(tct)«: '*PC'* mMM 
reproduced p«p«r copv^ Wh«n 
dMcribcd "Docu4n«M Not 

iub|«cl M» Ctain0«. lor liltfi Pflo* 
cod* OCMuto ■•• MCliOn on *'How 
10 0(d*r WC OocwTwrift", m |h« 
moM r«c«nt iNut of RIC, 



(Kiu|)ng th* term or orginlutlon of 
«M ddOum«A|, M oontrftttttd to Itft 
iU>|«cl nii«t1tr. TTw catwgofy rwna 
H Mowod t)y iho Ciit«oonf cod*. 



ED*54 3II 



CE 123436 




Cueer £<h»Cii*ofi for Waroen* 
Ceitnl Univ.* CbicifOt D1. 
Spoai Afcnc^Naiionil la it. of Educition 
(DHEW), W^hiofion. DC 

Repofi No— CU.:OSl*S 

MDiteMAy 73 

CliieerEdouboa(3id*Chlc«|0* III.* Mtf 13-17* 
IW73) 

Available ftom— Cunpin BookMOrc* 133 CoUeie 

Ave.* ChtciBO* ta. «0690($3.25> 
Uwiuete— EofHiht Fnoch 
IDIIS Pike MFOl/rON Pht ro«l«t«- 
Pub Type— DiMCftettoas/rbeMt (M) 
Dcicripten— *C«ner Oppoduniiio* Oieef Plan- 
nlngt Ciiem, *Danaftd Occupetient, *Cinploy<^ 
mew OppoduiMiies^ FrnkilcKt Ubor FoRe, Libor 
Muket* 'Manpower Needi. Occupational Aipira^ 
lion, OccupaUonel Cwdanct, Occepaiioni. >foca> 
iional CovAwlint* *1M:»rfcin| stamen 
IdeniifiefwContoitMm of States *Na|jonilOQCupa> 
donal Competency Ibtifdig Infinite. Illinou 
WMnen'aopportaniile* fbr employment wU) be dh 
lectty related to ihdr levtlof skill aiid enperknoe but 
alto to dw labor market demaodi thnrasb dw remain^ 
der of tte decade. Tbe number of woiken needed for 
all mijor eccupational cateforiei n cipected to in> 
c«e«*e by about ene*fiftA between 1970 and I9tO* but 
dw fvowth laie will vaiy by oecupaikmai fnwp. Pith 
ibt^onal and technical worken an expected to heve 
the hit^ctt pcedicied rate (39 pertent), foUoMod by 
KTvkc worken (33 pcitcnt), clerkal worken (26 
pcitcnt), iak» woAen (24 percent)* cialbmen and 
Ibtemen <20 percent)* manefcn and admhriatntofi 
(IS pcr^ni)^and openilva ill paum). V»i poMi^ 
cation conieiM a brief dltooauon and employment 
inftirraation oonceretnig oecipatkms for pn)(ituionai 
and tecbaicaJ worken* manepn and admiaittnm, 
■killed mdet* aalea wotken* clerical nvoiken^ aind 
aervice wecken. In order lor women to tafltcadvantafe 
of ineicei^d labor maiket demandi. employer at<^ 
titedea towanJ worklm women need to ctkadfc and 
women mtni; (II receive better cart«r ptimkmc and 
counaeting^ ( 3| chaise iheircarar iipirationa* tai ti) 
MIy utilize dte lowm of legal protection and aaif«t* 
! available to tbem. (S8) — 




iponeorinQ A^eney— agency re- 
•<N>nait)to lor initials. lurKkng. and 
managing itw raaeafch Protect 



fteP^rt Mtimber-«««igntd by 

OfiQHuior 



Oeecrtpttve PMa (peomeiion Mil} 



^ Oeacriptofn— aubject terma wh^ct) 
Chartcierifo aiibaiantive content 
OnK^ themes tttfmt. precedod bv en 
eatenak. ere pfmted m the Mbteci im* 
dex. 



/WenHftere— additional ictantitytng 
lanna tKM found tn trie Tlheaeurv* 
£/HC D**triPtvt, Only |ha rnaior 
terma. precedad by an aatensk, are 
printed m itM aubfoct index 
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The analysis of rnafn entries considered the following elements; 

1. Topic descriptors (Attitudes, Counseling, Curriculum, Employ- 
ment). 

2. Equity group descriptors (Physically Handicapped, Mentally 
Handicapped, Blacks, Hispanics, Women). 

3. Accession order (numbered 1-25 in reverse order from most 
recent to earliest accession number). 

4. Clearinghouse code. 

5. Year of publication. 

6. Pages. 

7. Publication type (12 publication codes: books, currictilum 
materials, directories, guides, journal articles and serials, 
prog ram/ project descriptions and evaluations, bibliographies, 
proceedings, questionnaires, research reports, speeches, 
theses) . 

8. Sponsor type (7 codes: federal, foundation, state/local 
education agency, other state agency, publisher, other 
sponsors, no sponsor indicated). 

9. Perfonner agency type (typed on the basis of institutional 
affiliation of first author, 10 codes: university or col- 
lege» federal agency, state agency, local agency, non-profit/ 
for-profitj council/commission, association, foundation, 
publisher, no infonnation that pennits classification). 

10. State location (typed according to institutional location of 
first author: U.S. states and territories, DC» Canada, 
other non-U. S.). 

n. Microfiche availability (1 if available from ERIC» NTIS. etc. 
0 otherwise). 

12. Paper (hard) copy availability (1 if available from ERIC, 
NTIS, etc.; 0 otherwise). 

13. Sex of authors {for first author: male» female* agency anony 
motis. Also coded by sex combinations of first, second, and 
other authors). 

14. Number of equity groups identified. 

The first six of the above elements are identical to the coding used 
in the CUE analysis. Publication type codes have been applied to ED 
accessions since mid 1977, but have been published in£IJE only since 
mid 1979. Sample entries were classified by the author using the 
coding categories listed in Appendix A. Sponsor type and perfonner 
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agency type were also coded by the author using the coding categories 
listed in Appendix A. Coding of state location was simple for most 
entries, with the major exception of speeches {"Papers presented 
dt,./') which are identified by the location of the meeting, conven- 
tion, etc* In these Instances, microfiche or hard copy of the docu- 
ment was retrieved to identify the first author's type of institution 
and its state location. Microfiche (MF) and hardcopy (HC) availa- 
bility are included in each RIE entry* Sex of author(s) could usually 
be determined from author(s) names* In cases where initials were 
used, microfiche or hard copy of the document was examined, and In 
cases where Initials were again used, various biographical directories 
were consulted* Since many documents, especially those produced by 
state and local agencies, are published anonymously, a special "agency 
anonymous" code was entered for these documents* When preliminary 
perusal of the sample entries suggested that some documents dealt 
exclusively with one group while others were Indexed with descriptors 
for several groups, we decided to code each entry according to the 
number of equity groups Identified* More than the five equity groups 
used in the search were considered (e*g*, American Indians, Japanese, 
Appalachian white, rural, low socio-economic, see Appendix A)* Major 
and minor descriptors, major and minor Identifiers, the title and the 
abstract were scanned to classify each item into one of three cate- 
gories; 1) only one equity group identified; 2) two or three groups 
identified; 3) more than three groups identified* 

RIE coded data were punched on IBM cards, verified, and sorted by 
content topic/group combinations* One-way and two-way tabulations 
were made for all qualitative codes (including the semi-decade of 
publication)* Quantitative data, on year of publication, number of 
pages, and journal circulation, were examined by two-way {topic by 
group) and three-way (topic by group by accession block) analysis of 
variance*^ 



^To deal with occasionally missing data, the unweighted mean analysis 
method (Weiner, 1971, pp* 445-449) was employed* This method proceeds 
on the basis that loss of observations in cells is essentially random 
and there are no grounds for permitting unequal frequencies to influence 
the estimation of population means* 
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TABLE 1 

ERIC JOURNAL ARTICLE ( CUE ) COVERAGE OF FOUR TOPICS 
WITH REFERENCE TO FIVE GROUPS 



cut 

Postings 
P-Z 11,942 


PHYSICALIY 
HANDICAPPED 

1 tenn 

P-704 

(0.33X) 


MEMTALIY 
HANDICAPPED 

2 tenns 

P-3.539 
fl.67X) 


BLACKS 

6 tenns 

P-Z.950 
fl.39X) 


Hi SPAN ICS 

2 tenns 

P-397 
(0.47X) 


UOMEN 
10 tenns 

P-8 ,656 
(4.08X) 


Totals 
for S Groups 

P°16|846 
(7.95X) 


ATTITUOES 

7 tenns 

P-1 8^969 
[9 .ox] 


(0.6X) 

107 
[15. ZX] 


(1.4X) 

Z63 

[7.4X3 


(3.6X) 
660 
[Z3.1X] 


(0.8X) 
151 
[15.1X3 


(9.1X) 
1,719 
[Z5.1X3 


(15. 4X) 
Z,9Z0 
[17.3X3 


EMPLOYMENT 

8 tenns 

P-6 J7Z 
[Z.9X] 


(i.ix) 

67 

[9.5X] 


(1.5X) 
9Z 

[Z.6X] 


(Z.9%) 
177 
[6.0X3 


(0.6X) 
37 

[3.7X3 


(IMX) 
684 

[lO.OX] 


(17. IX) 
1,057 
[6.3X3 


COUNSEL IMG 

)1 tenns 

P-9J44 
[4.3X] 


(1.4X) 

1Z6 
[17. 9X] 


(i.ox) 

90 

[z.sx] 


(1.8X) 
168 
[5.7X] 


(0.4X) 
34 

[3.4X3 


(5.9X) 
544 

[7.9X] 


(10. 5X) 

96Z 

[5.7X3 


CURRICULUM 

5 tenns 

P=15*84Z 
[7.5X] 


(.05X) 

8 

[i.ix] 


(0.5X) 
80 

[Z.3X] 


(0.6X) 
89 

[3.0X3 


(o.zx) 

31 

[3.1X3 


(i.zx) 

195 

[Z.8X3 


(Z.5X) 
403 

[Z.4X3 


Total Over 
4 Topics 

50JZ7 
[Z3.7X] 


(0.6X) 

308 
[43.7X3 


(i.ox) 

5Z5 

[]4.8%] 


(z.zx) 

1 J14 
[37.8X3 


(0.5X) 
Z53 
CZ5.4X3 


(6.3X) 
3 J4Z 
[36.3X3 


(10.7X) 
5,342 
[31.7X3 



18 



29 



2. The cell In the left-upper corner, found at the Intersection 
of **att1tudes" and "physically handicapped," shows the number of jour* 
nal articles associated both with "attitude" terms (postings P»18,969) 
and with the one physically handicapped term (P=*704). The 107 articles 
found at this intersection are [15. 2J] of the 704 articles dealing with 
physically handicapped; but they are only (0.6J) of the 18,969 articles 
dealing with attitudes. Note that percentages appearing in brackets 
throughout Table 1 have been computed by dividing the posting frequency 
in that cell by the posting appearing in the top margin. Thus, all 
percentages in brackets t%j refer to the total postings for that group 
(or the sum of the five groups on the right, or all of CUE on the 
left). All percentages appearing In parentheses have been computed by 
dividing the posting frequency in that cell by the postings appearing 
in the left margin. The percentages in parentheses {%} thus refer to 
the total postings for each topic (or sum of topics or all of CIJE ). 
Hence, percentages in brackets [%3 should be compared across columns 

in one row to examine for differences among groups in terms of how 
much of their total journal literature is posted to a particular topic* 
Correspondingly, percentages in parentheses (X) should be compared 
down rows in one column to examine for differences in how much of the 
total journal literature on each of the four topics is posted to a 
particular group. For example, with respect to "attitudes," we note 
that [25JJ] of all women's journal literature but only [7.4J] of all 
mentally handicapped literature deals with attitudes. With respect 
to "women," (9*1%) of all attitude journal literature and (11. IS) of 
all employment journal literature is Indexed with women's terms but 
only (1.2%) of the curriculum is indexed to women's terms. 

3. The right margin shows the total of postings across the five 
groups for each topic* In the case of attitudes, the five cell fre- 
quencies of 107, 263, 680, 151 , and 1,719 sum to 2,920, which is 
(15. 4J) of the 18,969 "attitude" postings* Because there may be 
some redundant postings (e*g*, the same article on attitudes might 
deal with Black women and thus be posted to the Black group and to 
the women group) » the percentages at the top of each row in the right 
margin should be interpreted as indicating that this percentage o r 
less of all journal articles posted for the topic pertain to the com- 
bination of these five special groups. The percentage in brackets at 
the bottom of each right marginal row show what portion this sum is 
when compared to the sum of all postings for the five groups* For 
example* the 2,920 postings for "attitudes" represent [17. 3J] of the 
16,846 sum of postings for all five groups. 

4* The bottom margin is interpreted in a manner analogous to 
the right margin* It shows the sum over the four topic areas for 
each group. What is perhaps remarkable here is that perhaps as much 
as 40 percent of all the journals posted to the physically handicapped, 
perhaps a third of the articles posted to Blacks or to women, and a 
fourth of the articles posted to Hispanics are concerned with these 
four topics*' By contrast, less than 15 percent of the articles on 
the mentally retarded are posted to any of these four topics. 



^Again there may be some redundancy for these totals over topics. 
However, it is less likely that an article would be posted to two or 
more of these four topics than it is that an article would be posted 
to two or more groups* 
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5. Comparison of the percentages in brackets across columns 
in each topic row confinn the basis for selecting these four topics. 
With four exceptions {mentally handicapped/attitudes, mentally 
hJndicapped/employment, mentally handicapped/counseling, and Hispanic/ 
counseling), the percentages for all special groups are in the expected 
direction; that is, percentages of the literature posted to attitudes 
{4 of 5 groups), employment (4 of 5 groups), and counseling {3 of 5 
groups) are higher than the percentage for these topics in all CUE 
literature Cleft margin %], while the percentages of curriculum liter- 
ature for ^11 five special groups are much smaller {approximately one- 
third) than the percentage of curriculum topics in the total C lOt 
literature. This dearth of curriculum articles is most pronounced in 
the case of the physically handicapped where only eight articles were 
found, representing 0.05 percent of the CIJE curriculum literature 
and 1.1 percent of all physically handicapped postings in CIJE . 
Conversely, the women's group exhibits the highest levels oT^over- 
representation." Here one-fourth (as compared to 9% of all CUE 
articles) deal with attitudes, 10 percent (compared to 2.9%) deal 
with employment and almost 8 percent (compared to 4.3%) deal with 
counseling. Thus, perhaps as much as 43 percent of the articles on 
women deal with these three topics, while only about 16 percent of 
CUE articles are posted to these topics. 

We have already noted that, with the partial exception of the physi- 
cally handicapped, nearly all of the cell frequencies in Table 1 are 
significantly higher (for attitudes, employment, and counseling) or 
significantly lower {for curriculum) than would be expected given the 
proportions of postings of these four topics for all CUE articles. 
It is also true that the five special groups display different distri- 
butions by topics when compared to one another. 

For this comparison we must compute expectations based on the totals 
in the right and bottom margins.^ Note that expected frequencies 
here are computed on the basis of the right and bottom marginal totals 
over the five groups and over the four topics , not from the left and 
top marginal totals used previously to compare group/topic postings 
to the proportion of ^11^ items in the CUE data base posted to the 
topic and group. 

Table 2 presents an internal comparison based on proportions of 
the 5,342 postings summed over the five groups and four topics (rather 
than on proportions by topic and group of the 211 ,942 total of all CUE 
postings previously considered). Each cell displays the actual (A) and 
the expected (E) frequency of postings for the cell. Adjusted residu- 
als (AR) are also displayed. Negatively signed residuals indicate 



^A Chi square test for independence between topic and group classifi- 
cations is highly significant, indicating that the cell frequencies 
are not at all well fitted by the (right and bottom) marginal frequen- 
cies in Table 1. However, with 5,342 postings this is a trivial 
result. Finding a significant chi square, we proceeded to examine the 
adjusted residuals {see Appendix B) for each cell to determine where 
the independence model breaks down. The cells in Table 2 exhibiting 
significant adjusted residuals are marked with asterisks. 
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TABLE 2 

INTERNAL COMPARISON OF ACTUAL (A) AND EXPECTED (E) POSTINGS IN CIJE 
FOR FOUR TOPICS WITH REFERENCE TO FIVE GROUPS. WITH ADJUSTED 
RESIDUAI.S (AR) FOR CELLS 





PHYSICALLY 
KAKD I CAPPED 


MENTALLY 
HANDICAPPED 


BLACKS 


HISPANICS 


UOMEN 


TOTAL 
OVER GROUPS 


AniTUDES (A) 


107 


Z63 


680 


151 


1719 


Z9Z0 




1 vQ 
*** 




*** 




1717 




(AR) 


-7.2 


-2.2 


+4.8 


+1.8 


+0.0 




EHPLOYKENT (A) 


67 


92 


177 


37 


684 


1057 




w 1 




*** 


** 


*** 




(AR) 


+1.0 


-1.4 


-3.7 


-Z.2 

■ 


44.4 




COUNSELING (A) 


126 


90 


168 


34 


544 


96Z 


(E) 


55 

*** 


95 


Z01 
** 


46 


566 




(AR) 


+10.7 


.0.6 


-Z.8 


-1.9 


-1.6 




CURRICULUH (A) 


8 


80 


89 


31 


195 


403 


(E) 


23 
*** 


40 
*** 


84 


19 
** 


Z37 
*** 




(AR) 


-3.4 


+7.0 


■K).6 


+2.7 


-4.3 




TOTAL OVER 
TOPICS 


308 


5Z5 


1114 


253 


31 4Z 


5342 
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that the expected frequency Is greater, positively signed residuals 
Indicate the actual frequency is greater. Adjusted residuals over 
2.0 (probability is less than .05) are marked by two asterisks. 
Adjusted residuals over 3.3 (probability is less than .001) are marked 
with three asterisks. Twelve of the 20 cells display statistically 
significant discrepancies between actual and expected journal postings. 

The attitude literature is marked by three significant discrepancies. 
The articles for physically and mentally handicapped are both substan- 
tially less than the number that would be expected, while the articles 
for Blacks are significantly more than the number expected* 

For employment literature the major discrepancies involve an under- 
representation of articles for Blacks and Hispanics and an overrepre- 
sentation for women. 

As previously noted in Table 1, although the 126 counseling articles 
dealing with the physically handicapped represent only 1.4 percent 
of all counseling journal literature, they represent 17.9 percent of 
all the journal literature posted to this group. When compared to the 
other groups this is far higher than expected (126 vs. 55). On the 
other hand, the counseling literature for Blacks is less than would be 
expected (168 vs. 201). 

We have previously noted that the journal literature dealing with cur- 
riculum tends to be significantly underrep resented for all groups when 
compared to the total number of curriculum articles in CIJE . When we 
make an internal comparison, four of the five groups exhibit marked 
discrepancies* The mentally handicapped and the Hispanics have mariy 
more curriculum journals (80 vs* 40, 31 vs. 19, respectively) and the 
physically handicapped and women have markedly fewer journals (8 vs. 
23, 195 vs. 237, respectively) than would be expected given the total 
of only 403 curriculum postings over the five groups* In this 
instance. Blacks are the only group with actual postings (89) near 
expected postings (84). 

Reviewed by group, we note that every group has one or more topic 
postings that are discrepant. For the physically handicapped there 
are three discrepancies: both attitude and curriculum postings are 
less than would be expected while conseling is remarkably over expec- 
tation. 81acks also have three discrepancies with employment and 
counseling literature under, and attitude literature over expectation* 
The remaining groups each have two significant discrepancies* For 
women, employment literature is more than would be expected while 
their curriculum literature is less* Mentally handicapped and 
Hispanics are both over expectation in curriculum; mentally handi- 
capped are under expectation on attitudes, while the Hispanics are 
under expectation on employment. 

We thus see, that whether we compare topic/group cell postings to the 
external references of all CIJ E postings, or to the Internal reference 
of the sample marginal totals," there are marked differences among the 
groups and among topics that preclude simple generalizations about 
the topical patterns of journals for these groups. 
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TABLE 3 



ERIC DOCUMENT ( RIE ) COVERAGE OF FOUR TOPICS 
WITH REFERENCE TO FIVE GROUPS 



Total RIE 
Postings 

P-?78,674 


PHYSICALLY 
HANOICAPPEO 

1 tern 
P-782 

(0.4%) 


MENTALLY 
HANOICAPPEO 

2 terms 

P-2.381 
(1.3%) 


BUCKS 

'6 terms 

P-3.877 
(2.21) 


HISPANICS 
2 terms 

P>2,606 
(1.5%) 


WOMEN 

10 terms 

P-7.917 
(4.4%) 


■ 

Totals 
for 5 Groups 

P-17.563 
(9.8%) 


AHITUOES 

^ terms 

P- 18. 051 
[10.1X1 


(0.4%) 

70 

[9.0X] 


(1.1%) 
201 

[8.4%] 


(5.4%) 
981 
[25.3%] 


(2.6%) 
477 
[18.31] 


(10.1%) 
1.832 
[23.1%] 


(19.7%) 
3.561 
[20.3%] 


EHPLOYMENT 

8 tenns 

P-10,791 
[6.01] 


(0.7%) 

80 

[10.2%] 


(1.3X) 
136 

[5.7%] 


(4.4%) 
478 
[12. 3S] 


(1.9%) 
208 
[8.01] 


(11.21) 
1.213 
[15.3%] 


(19.6%] 
2.115 
[12.0%] 


COUNSELING 

11 terms 

P-8.&42 
[4.9%] 


(1.1%) 

94 
[12.01] 


(1.4%) 
120 

[5.01] 


(2.01) 
175 
[4.5%] 


(1.21) 
104 
[4.01] 


(6.9%) 
612 

[7.7%] 


(12.5%) 
1.105 
[6.3%], 


CURRICULUH 

5 terms 

P-24.462 
[13.7%] 


(0.2<) 

48 

[6.1%] 


(1.4») 
350 
[14.7X] 


(0.81) 
205 
[5.3S] 


(1.3%) 
315 
[12.1%] 


(1.5%) 

375 

[4.7X] 


(5.3%) 
1.293 
[7.4%] 


Total Over 
Topics 

62.146 
[34.8%] 


(0.5%) 

292 
[37. 3X] 


(1.3X) 
807 

[33.91] 


(3.01) 
1.839 
[47.4%] 


(1.8%) 
1.104 
[42.4%] 


(6.5%) 
4.032 
[50.91] 


(13.01) 
8,074 
[46.01] 
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C. RIE Document Coverage 



Table 3 presents the data for documents indexed In Research in 
E ducation ( RIE ). This table is read 1n the same my as Table 1 • 
Although the postings to RIE (P=178,674) are substantially fewer 
than those to C I J E (P=21lTW2), we note that there are substantially 
more documents in RIE than in CIJE concerned with employment (10,791 
in RIE vs. 6,172 in CIJE ) and with curriculum (24,462 vs. 15,842). 
Moreover, the number of "postings in R[E to the special groups is 
larger (17,563 in RIE vs. 16,846 in ^TTt ). The differences are most 
marked for Hispanics (2,606 documents, representing 1.5% of all RIE 
documents, vs. 997 articles, representing 0.5% of all CUE articles), 
and Blacks (3,877 vs. 2,950), but there Is a markedly smaller litera- 
ture for mentally handicapped (2,381 in RIE^ vs. 3,539 in CUE ). 

We again find, with again the exception of the mentally handicapped, 
a tendency for attitude and employment topics to be overrepresented 
(approximately 20 percent vs. 10 percent for attitude topics, and 
12 percent vs. 6 percent for employment topics). Counseling topics 
are also over expectation, but only for the physically handicapped 
and for women. Conversely, curriculum topics tend to be underrepre- 
sented for every group but the mentally handicapped. 

While the total of postings summed over four topics and five groups 
is 5,342 for CIJE , representing 32 percent of the sum of group post- 
ings, the sum is 8,074 for RIE , representing 46 percent of the sum 
of group postings. We thus see that; 1) RIE exhibits a different 
pattern of postings to topics, with substantial ly higher absolute num- 
bers and percentages of postings to curriculum and employment topics; 
2) R|E exhibits a differnt pattern of postings to groups, with mark- 
edly higher numbers (and percentages) of postings for Hispanics and 
Blacks; similar amounts for women and physically handicapped, but 
fewer postings for mentally handicapped; 3) despite these differences, 
there is still the tendency in RIE and CUE for the same topics to be 
overrepresented (attitudes, employment, counseling) or underrepresented 
(curriculum) . 

We also find an (even more marked) pattern of internal differences 
when the ppstings for the five groups are compared to one another. 
Table 4 displays the actual and expected frequencies (based on the 
right and bottom marginal totals in Table 3) and the adjusted resid- 
uals. It is read the same way as Table 2. In Table 4, 15 of the 20 
topic/group cells display significant discrepancies between actual 
and expected postings. All four cells for women indicate discrepan- 
cies, with postings for attitude, employment, and counseling topics 
all greater than expected, while curriculum postings are fewer than 
expected. Blacks also exhibit this pattern partially, with markedly 
greater postings for attitudes and markedly fewer than expected 
postings for curriculum. However, Blacks have fewer counseling 
documents than expected. The remaining three groups each display a 
somewhat different pattern, in both the direction and magnitudes of 
discrepancies. Physically handicapped are underexpectation in atti- 
tudes and over in counseling. Mentally handicapped are also under in 
attitudes, but also under in employment and very markedly over in 
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TABLE 4 



INTERNAL COMPARISON OF ACTUAL (A) AND EXPECTED (E) POSTINGS 
IN RIE FOR FOUR TOPICS WITH REFERENCE TO FIVE GROUPS. WITH 
ADJUSTED RESIDUALS (AR) FOR CELLS 





PHYSICALLY 
HANDICAPPED 


KENTALLY 
HAKDICAPPEO 


eucKs 


HISPANICS 


WOMEN 


ToUl 
Over Groups 


ATTTTlinrC i t\ 


/U 






mi 


IOj£ 


J^Ol 


(E) 


129 


356 


oil 


487 


1778 








*** 


*** 








(AR) 


-7.0 


-11.6 


+9.1 


-0.7 


+2.5 




PMDI nVMPMT { k\ 


AD 


1 4v 


ATA 








(E) 


7b 


21 1 


482 


289 


1056 














*** 




(Aft) 




-6.3 


-0.2 


-6.0 


+7.9 




COUNSELING (A) 


94 


120 


175 


104 


612 


1105 


(E) 


40 


110 


252 


151 


552 






*** 




*** 


♦»* 


*** 




(AR) 


+9.4 


+1.0 


-5.9 


-4.5 


+3.9 




CURRICLLUH (A) 


48 


350 


205 


315 


375 


1Z93 


(E) 


47 


129 


295 


177 


646 










*** 




*** 




(AR) 


+0.Z 


+22.3 


-6.6 


+12.3 


-16.4 




Total Over 
Topics 




d07 


1839 


1104 


4Q3Z 


8074 
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curriculum. Hispanics also display a pattern of being under in 
employment and over in curriculum, but they are also under in the 
counseling area. Hence, the groups are different from one another 
both in their CUE journal postings and In the £Xi document postings. 

However, there is some similarity in the discrepancy patterns found 
in Tables 2 and 4. To facilitate this comparison the adjusted 
residuals from Tables 2 and 4 are reproduced in Table 5. 



TABLE 5 

COMPARISON OF ADJUSTED RESIDUALS FOR CIJE AND FOR RIE 
BASED ON TABLES 2 and ? 





PHVSlCALLy 
HANDICAPPED 


MENTALLY 
HANDICAPPEO 


BLACKS 


HISPANICS 


WOMEN 


ATTITUDES (CUE) 
(RIE) 


-7.2 ♦** 
-7.0 *♦* 

S 


-2.2 ** 

-n.6 *** 

S 


+4.8 *** 
+9.1 

S 


+1.8 
-0.7 


+0.0 
+2.5 ** 
D 


EMPLOYMENT (CUE) 
(RIE) 


+1 .0 
+0.5 


-1 .4 

-6.3 ♦** 
D 


-3.7 *** 
-0.2 

0 


-2.2 

-6.0 *♦* 

S 


+4.4 *** 
+7.9 **♦ 
S 


COUNSELING (CUE) 

m) 


+10.7 **♦ 
+9.4 

S 


•0.6 
+1.0 


-2.8 ** 
-5.9 *♦* 

S 


-1.9 
-4.6 

D 


-1.6 
+3.9 

D 


CURRICULUM (CUE) 

(RrE) 


-3.4 *** 
+0.2 

D 


+7.0 
+22.3 

S 


+0.6 

-6.6 *♦* 
D 


+2.7 ♦* 
+12.3 

S 


-4.3 *** 
-T6.4 **♦ 

S 




We see 1n Table 5, that the adjusted residuals agree (Sesame) both 1n 
significance and sign for ten of the twenty cells. In three more 
cells there is agreement in tlie sense that although the signs 
may differ, there is no significant discrepancy indicated. In five 
of the remaining seven cells, where there are differences (D), the 
R I E adjusted residuals are significant while the C JJ Jg residuals are 
not, while in only two cases (Blacks/employment and physically 
handicapped/curriculum) CUE adjusted residuals are significant while 
RIE residuals are not. We thus see that there is some, but a far 
from perfect, similarity in the CUE and RIE literature regarding the 
tendency for a topic to be significantly over or under expected fre- 
quencies in postings for a particular group, when expected frequencies 
are based on the total of topical postings over all five groups and 
over all four topics. 



I 0> ERIC Data Base Coverage Sumnary 

I By the Spring of 1980, the ERIC data base exceeded three hundred and 

I ninety thousand articles/documents. A total of over thirty-four 

I thousand postings in the data base were made to the five equity groups 

I considered in the study: women, 16,573 articles/documents; Blacks 

I 6,827; Hispanics, 3,603; mentally handicapped, 5,920; and physically 

I handicapped, 1,486. Four substantive topics were searched for each of 

I these five groups. The topics of attitudes, employment, and counseling 

I were selected because a previous study indicated that literature on 

I these topics tended to be more frequently indexed to special groups. 

I A fourth topic, curriculum, was selected as representative of topics 

I which are less often indexed to special groups. Although there were 

I several differences between the special groups searched in the pre- 

I liminary study and the current study, this pattern of topical over- 

I and under-posting for special groups was confirmed for both the CIJ^ 

I article and the RIE document literature. For all ERIC literature 

I ( CIJE plus RIE), the percentage of the postings to the five groups is 

I approximateTy^twice as high for attitude topics (18.8% vs. 9.5%) and 

I for employment topics (9-2% vs. 4.3%), and half as high for curriculum 

I topics (4.9% vs. 10.3%) when compared to the percentage of postings to 

I topics for all ERIC articles/documents. Although the difference in 

I percentages (6*0% vs. 4.6%) is less for the counseling topic, it is 

I in the predicted direction of higher percentage of postings for the 

I special groups. 

I Although only four topics (of potentially hundreds of topics) were 

I examined, it is evident that these four account for sizable propor- 

I tions of the literature posted to the five groups, amounting to 

I nearly a third of the sum of the postings for the five groups for 

I CIJE articles and nearly half of the group postings f or £I£ documents. 

1 There are remarkable differences between the CUE and RI£ literature 

I in the amounts and proportions of the literature posted to topics and 

I to groups. In numbers and in percentages, there are substantially 

I more postings to curriculum and to employment topics in RI JE than in 

I CUE . Thee are also remarkably higher numbers and percentages of 

I postings to Hispanics and Blacks in RI£ than in CUE. However, the 

I number of postings to mentally handicapped is significantly less In 

I RJLE than in CIJE . 
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Aside from the general tendency for most groups to receive more 
postings for attitude, employment, and occasionally counseling topics, 
and to receive fewer postings for curriculum topics, there are few 
similarities but many differences among the five groups. These dif- 
ferences are expecially marked when internal comparisons are made 
among individual postings for the twenty combinations of five groups 
and four topics. Chi square tests of independence (between groups 
and top1cs)were highly significant for both the C I JE and RIE postings, 
with 12 of the 20 cells in the CIJE analysis and"T5"of theTO cells 
in the RIE_ analysis displaying highly significant discrepancies 
between expected and actual numbers of postings* Although there are 
gross similarities between the CIJE and the RI£ chi square analyses 
(thirteen of the twenty corresponding pairs of topic/group cells were 
either both insignificant or were both significant and with the same 
sign), there are no very striking patterns of similarity among groups 
or among topics in the actual/expected freauency discrepancy patterns 
for either CIJE or RIE. He are thus forced to conclude that generali- 
zations from one to another equity group in terms of the amounts or 
proportions of _C IJE or RIE postings to various topics, or from one 
topic to another topic In terms of proportions of postings to various 
groups can be made only very roughly, and with many errors.^ 

While considering the data on CIJE and RIE postings, it is important 
to review the major limitations to such data that were identified by 
Paisley, et al., namely: 

1- No external criterion tells us how many documents/articles 
should pertain to a particular topic with reference to a 
particular group. Across time, sites, and the range of 
activities from research through practice* is the optimum 
number of documents 'irticles 50, 100, 500, 1,000 or 5,000? 
*'The sky is not the limit,*' because each document or article 
represents a federal investment in information processing, 
not to mention the costs incurred by the original authors, 
and publishers or distributors. 

2. Except by relying on statistical coverages, we cannot say 
that 50 documents/articles pertaining to one topic and group 
contain only 10$ as much information as 500 documents/articles 
pertaining to another topic and group. In fact some discount 
should be applied to t^e information value of a large number 
of documents/articles pertaining to the same topic and group 
because content redundancy increases concomitantly. 



^Crude estimation is of course possible. For example, since the lit- 
erature on women constitutes approximately half of all the postings 
to groups, one would always be correct in predicting that there would 
be more CIJE or RIE. documents posted to any of the four topics for 
women than -for any other group. Note, however, that although there 
are 3 ,877 RIE documents posted to Blacks, while Hispanics have far 
fewer (2,606) , Hispanics have fifty percent more curriculum documents 
than Blacks (315 to 205). ^ ^ 
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These caveats say that no cell [in Tables 1 & 3] Indi- 
cates too little, too much, good, or bad Infonnation 
per se* However, internal comparisons [within tables] 
raise a number of questions about the concept of infor- 
mation equity* 



Although we are not able to employ any external criterion to deal with 
questions of adequacy or relevance, in the next two sections we shall 
go subtantially beyond sheer counts of articles/documents to discover 
something about their content* 



E* CUE Content Analysis Results 

While the previous three sections have considered counts for popula- 
ti^ons (the "universe** of pIJE and RIE accessions from the inception 
of ERIC in the 1960"s through to eTFTy 19B0), this and the next 
sectiqn focus on samples from those populations* As described in 
Section III B, twenty systematic samples of CUE Items were drawn. 



examine these CUE samples in terms of the following characteristics: 
1) publication date; 2) page length; 3) journal scatter, 4) journal 
circulation; and 5) clearinghouse distribution* 

1 * Publ ication date * The 483 journals represented in the twenty 
samples span eleven years, from 1969 to 1979* Examination of Table 6 
indicates that there is a substantial difference in the average date 
of publication among the samples for groups, with the sample journal 
literature for women averaging fully a year more recent and that for 
the physically handicapped over a year more recent than the journal 
literature for the other three groups* The differences in average 
publication dates among topics (averaged over the five groups) are 
relatively small and not significant* However, the presence of a 
significant interaction term requires a closer examination of row 
and column differences. Focusing first on individual cell means, we 
note the following. The physically handicapped/attitudes articles 
average roughty a year older (19)74.20, while the curriculum articles 
average more than a year more recent, 76.38, than the overall average 
publication date for this group, 75*26. 

While the curriculum articles for the physically handicapped are some- 
what more recent, the curriculum articles for Blacks and for Hispanics 
are both more than a year older than the average for these groups* 



l^Twenty-five items were drawn from each of 19 cells and all eight 
of the journal entries in the physically handicapped/curriculum cell 
were drawn, thus producing a total sample of 483 items from a popula 
tion of 5,342 postings* The sample thus represents a nine percent 
sample of the population of CUE postings for these five groups and 
these four topics* However, the individual cell sa'npling fractions 
range from 100 percent to less than two percent. 



Paisley, et al* (1979, pp* 13-14) 



one for each topic/group 




In this section we shall 
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TABLE 6 



UNWEIGHTED MEANS ANALYSIS OF VARIANCE: 
PUBLICATION DATES FOR SAMPLES OF TWENTY TOPIC/GROUP COMBINATIONS* 



Cell leans 





PHYSICALLY 
HANOI CAPPED 


HEKTALLY 
HANOI CAPPEO 


6LACKS 


HI SPAN ICS 


UOHEH 


Average 


ATTITUDES 


74.20 


73.46 


73.92 


74.32 




74.72 


74.13 


EMPLOYHEHT 


74.96 


74.12 


74.52 


73.66 


74.92 


74.46 


COUHSELIHG 


75.46 


73.12 


73.26 


74.66 


74.60 


74.23 


CURRICULUM 


76.36 


74.04 


72.12 


72.46 


75.12 


74.03 


Average 


75.26 


73.69 


73.46 


73.64 


74.64 


74.22 



Source of Variation 


SS 


df. 


HS 


F 


P level 


Topics 


12.656 


3 


4.219 


0.46 


HS 


Groups 


221.932 


4 


55.483 


6.11 


P<.01 


Interaction 


197.524 


12 


16.460 


1.81 


P<.05 


Within Cell 


4*202.595 


463 


9.077 







*Note: N=25 for all cells except physically handicapped/curriculum 
where N=8* Hannonfc mean of cell frequencies - 22*60. Cell means 
are averages for years of publication mfnus 1900* 
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Finally, the employment journal literature for Blacks is more recent 
than the average for Blacks. Note that these topic/group interaction 
differences tend to balance out over groups {physically handicapped 
and Blacks) and across the curriculum topic. Considering the overall 
range of eleven years from the earliest to the most recent journal 
articles in these twenty samples, the differences for publication 
dates among the curriculum samples are especially remarkable, ranging 
from (19)72.12 for Blacks and 72.48 for Hispanics to much more recent 
averages of {19)75.12 for women and 76.38 for physically handicapped.'! 
The most marked differences among topics within groups are for the 
physically handicapped. Blacks and Hispanics; however only the differ- 
ence in publication date averages atnong topics for Blacks is signifi- 
cant. '2 

To summarize, the dates of journal publication for the articles in 
these samples ranged from 1969 to 1979, with an overall average date 
of March 1974 {74.22). Averaged across the four topics, the journal 
literature for physically handicapped and for women on these topics 
averages more than a year more recent than the literature for the 
other three groups. While the size of these group differences are so 
large that th^ override a significant interaction effect, the inter- 
action effect points to at least two significant simple effects: 
a) for differences among groups for the curriculum topics, and b) for 
differences among topics of the Black group. In the curriculum area, 
the journal literature for the physically handicapped and for women 
is much more recent than the journal literature for Blacks and His- 
panics. Within the Black group, journal articles dealing with employ- 
ment are the most recent, while curriculum articles are the oldest. 

2. Page length . Table 7 presents the results for the average 
number of pages per journal for each topic/group combination. While 
this sample of 483 journals ranged from one to 56 pages in length, 
the overall average is just over seven pages. Although there is no 
interaction between topic and groups, the main effects for both topic 
and group are highly significant. Averaged over groups, the articles 
for counseling and for curriculum are substantially shorter per 
articles (6.05 pp. and 6.38 pp. respectively) than those for attitudes 
and employment {7.40 pp. and 8.27 pp. respectively). Averaged over 
topics, the average pages are markedly less for both handicapped 
groups than th^ are for Blacks, Hispanics and women. The additive 
effect of employment {topic) plus Blacks, Hispanics, or women (group) 
results in cell averages for these combinations that are especially 
large {8.84 pp., 10.56 pp., and 11.72 pp. respectively). 

When these page averages are multiplied by the number of journals 
posted to each cell, we obtain an estimate of the total number of 
journal pages in CUE that have been posted to each group/topic. 



l^The F-test of the simple effect of groups for curriculum is F=7.94, 
which for 4 and 463 degrees of freedom is highly significant. 

l^The F-test for the simple effect of topics for Blacks Is F=2.624, 
which for 3 and 463 degreees of freedom just reaches the P=.05 level. 



31 42 



TABLE 7 



UNWEIGHTED MEANS ANALYSIS OF VARIANCE: 
PAPER LENGTH FOR SAMPLES OF TWENTY TOPIC/GROUP COMBINATIONS* 



Cell Means 





PHrSlCALLY 
HAffOICAPPEO 


MENTALLY 
HAffOICAPPEO 


BLACKS 


HlSPAfflCS 


WOMEN 


Average 


ATTITUDES 


6.08 


S.16 


7.96 


10.68 


7.1Z 


7.40 


EMPLOYMENT 


S.68 


4.S6 


8.84 


10. S6 


11,72 


8.27 


COUNSELING 


5.72 


5.40 


S.40 


6.Z4 


7.48 


6. OS 


CURRICULUM 


4. SO 


S,80 


7.52 


S.84 


8.24 


6.38 


Total 


S.SO 


S,Z3 


7.43 


8.33 


8.64 


7.02 



Summary of Analysis of Variance 



Source of Variation 


SS 


df. 


MS 


F 


P level 


Topics 


346,48 


3 


115.49 


3.86 


P<,01 


Groups 


907.45 


4 


226.86 


7*59 


P<.01 


Interaction 


625,07 


12 


52.09 


1,74 


NS 


Within Cell 


13,842.40 


468 


29.90 







♦Cell N's are 25, except for phystcally handicapped N=8. Harmonic mean 
of cell frequencies = 22.6. 
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These total page estimates are presented In Table 8. The number In 
the lower portion of each cell is a projection computed by multiply- 
ing the total number of journals posted to each topic by group conw 
blnation, by the sample average paper length that appears In the top 
of each cell. While these estimates are non-redundant the right and 
bottom marginal totals are redundant since the same journal article 
might be posted to more than one group or more than one topic. Never^ 
theless the grand total of over forty thousand journal pages Is a large 
one. Note, however, that over sixty percent of this total is repre- 
sented by pages of journals that have been posted to women, while the 
totals over all four topics are roughly only two thousand pages for the 
physically handicapped and for Hispanics, and under three thousand pages 
for the mentally handicapped. The ratios for topics are almost in the 
doubling order of 3, 6, 12, 24, with over seven and a half times as much 
journal literature on attitudes as on curriculum. The most extreme topic/ 
group difference is between the 36 journal pages for physically handi- 
capped/curriculum and the estimated 12,239 pages for women/attitudes. 



TABLE 8 

ESTIMATED NUMBER OF JOURNAL PAGES IN CIJE FOR EACH 
COMBINATION OF FOUR TOPICS AND FIVE GROUPS 
(NUMBER OF ARTICLES, AVERAGE PAGE LENGTH, ESTIMATED TOTAL PAGES) 





PHYSICALLY 
KANOICAPPEO 


MENTALLY 
HANDICAPPED 


6LACfCS 


HISPANICS 


WOMEN 


AniTUDES 
21,273 


107 6.06 
651 


263 5.T6 
1,357 


680 7.96 
5,413 


151 10.66 
1,613 


1,719 7.T2 
12,239 


EMPLOYMENT 
10,773 


67 5,66 
381 


92 4.56 

420 


177 6.S4 
1,565 


37 10.56 
391 


684 1U72 
6,016 


COunSELING 
6,395 


126 5.72 
721 


90 5.40 
486 


166 5.40 
907 


34 6.24 
212 


544 7.46 
4,069 


CURRICULUH 
2.957 


6 4.50 
36 


80 5.80 
464 


89 7.52 
669 


31 5.84 
161 


195 8.24 
1,607 


41.398 


1,769 


2,727 


6,554 


2,397 


25,931 
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3. Journal "scatter ." Given the fact that pJE Currently Indexes 
articles for over 800 journals, ft my not be surprising to learn that 
it would be necessary to read quite a few journals to find the litera- 
ture included In these CUE samples. However, we were surprised to 
discover that the 483 articles Included in the overall sample would 
require access to over two hundred journals. Including several that no 
longer exist. To convey some overall idea of how many journals might 
have to be read three figures are displayed for each cell in Table 9. 
The first Indicates the number of different journal titles included in 
each sample; the second indicates the number of journals that must be 
consulted to find half the articles in the sample (i.e., 13 articles); 
the last figure indicates the number of articles that appeared in the 
one most frequently represented journal. For example, the 25 articles 
for attitudes/physically handicapped appeared in 15 different journals; 
however, half of this sample (13 articles) could be found in just 
three journals, and one of these contained ten of the 25 articles in 
the sample. The most concentrated journal literature is counseling/ 
physically handicapped, where two journals will cover half the sample 
and one journal contains twelve of these thirteen articles. However, 
oven in this instance ten journals must be consulted to find all 25 
articles. At the opposite extreme Is attitudes/women, where each of 
the 25 articles in the sample appeared In a different journal. Inspec- 
tion of the column averages reveals that the journal literature for 
the handicapped is concentrated in fewer journals, while the literature 
for Blacks and women is most dispersed. Inspection of row averages 
indicates that there are no pronounced differences in journal dis- 
persion for the four topics. The counseling literature tends to be 
slightly more concentrated (on the average, one must still consult 
more than five journals to find half the articles in samples of 25 
articles) while literature on curriculum and on attitudes is slightly 
more dispersed (here, on the average, more than seven journals must 
be consulted to find half the articles in samples of 25 articles). 
He note that, overall, an average of 18 journals must be consulted to 
find 25 articles in a sample; nearly seven journals must be consulted 
to find half the number (13) of articles; and subscription to the one 
'*key*' journal in each topic/group area, would, on the average, expose 
the reader to about one-fifth of the articles in a sample of 25.^^ 



l^The reader may note (see Table 1) that high journal title concen- 
tration in the sample tends to be associated with a high sampling 
fraction (fewer journals in the population), and low concentration 
is associated with a low sampling fraction. Excluding the aberrant 
curriculum/physically handicapped cell, the correlation between the 
half sample (HS) journal title count and the log (10) of the sampling 
fraction over the 19 cells is -.33. However, this correlation is 
not significantly different from zero. 

^^However, one journal. Rehabilitation Counseling Bulletin , covers 30 
of the 100 articles in the four topic samples for physically handicapped. 
Two journals. Mental Retardation (15 articles) and Education and Train - 
ing of the Mentally Handicapped (13 articles), cover 28 of the 100 
articles in the samples for mentally handicapped. No single journal 
covers more than seven of the 100 articles in the four topic samples 
for Blacks, Hispanics, or women. 



. TABLE 9 



NUMBER OF JOURNAL TITLES APPEARING IN FULL SAMPLES (FS). 
NUMBER OF JOURNAL TITLES APPEARING IN HALF SAMPLES (HS). AND 
NUMBER OF ARTICLES IN ONE Q.) MOST FREQUENTLY APPEARING JOURNAL (AIJ) 





PHYSICALLY 
HANDICAPPED 


MENTALLY 
HANDICAPPED 


BLACKS 


HI SPAN ICS 


WOHEN 


Average 


AHITUOES 


FS 
HS 
AIJ 


3 

10 


V 

2 

9 


23 

11 

2 


21 

9 

4 


25 

13 

1 


19.0 

7.6 

5.2 


EHPLOYHEtiT 


FS 
HS 
AIJ 


13 

3 

8 


15 

4 

5 


22 

10 

2 


20 

8 

3 


19 

7 

4 


17.8 

6.4 

4.4 


COUNSELING 


FS 
HS 
AIJ 


10 

2 

U 


17 

6 

6 


19 

7 

5 


16 

5 

4 


19 

7 

4 


16.2 

5.4 

6.2 


CURRICULUH 


FS 
HS 
AIJ 


8* 

4* 

1 


15 

3 

8 


21 

9 

4 


18 

6 

4 


23 

11 

2 


19.2** 

7.25** 
3.8 


Average 


FS 
KS 
AIJ 


12.7** 

2.67** 
7.75 


14.5 

3.75 

7.O0 


21.2 

9.25 
3.25 


18.8 

7.00 
3.75 


21.5 

9.50 
2.75 


18.00** 

6.63** 
4.90 



* There were only el9ht articles for this comblnatlont each appeared In a separate 
Journal* HeiKe this number of Journal titles Is not directly comparable with the 
number of Journal titles In other cells. 

** Excludes curriculum/ physically handicapped. 
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Chi squt>re tests of independence show that the topfc and group niargina] 
total?; for full sample and half sample counts produce expected frequen- 
cies that closely fit the actua] frequencies. Similar chi square tests 
of fjqual marginal distributions for totals of full samples and for half 
samples show that there Is no significant difference for topics but 
that the difference for groups is significant* These results lead to 
three simple conclusions: 1) there ar e significant differences in the 
number of journals that must be consulted to cover the literature for 
different groups; 2) there are jio substantia] differences in the number 
of Journals that must be consulted to cover the literature for topics 
pertaining to (these) special groups; 3) there is jio interaction between 
group and topic. 1^ Given these conclusions, the averages at the bottom 
of Table 9 deserve closest attention. Among other things, they tell us 
that subscription to as few a3 three or four journals might be suffici- 
onl to cover as much as half the articles (in samples of 25) for a 
specific topic for either the physically handicapped or mentally handi- 
capped, while one would need to subscribe to twice that number of 
journals (approximately seven) to cover half the articles in one topic 
for Hispanics and to nine or more journals to cover half the articles 
on a topic for either Blacks or women. Subscription to just one 
"key" journal in any topical area would expose the reader to only a 
minor fraction of the (sample N=25) literature, ranging from less than 
a third of the articles for physically handicapped to less than one- 
ninth of the articles for women. The practical implication of these 
data on journal "scatter" is that even modestly adequate libraries or 
other information services must subscribe to a relatively large number 
of journals. (For example, an attempt to provide direct access to, 
say, half the available CUE literature that might be found in an eric 
search on broad topical area such as those used in this study for a 
particular group would, on the average, require subscription to any- 
where from three to ten journals per group. Allowing for some redun- 
dancy among groups (see Footnote 14), it still might require subscript 
tion to 20 to 30 journals to cover half the journal literature in one 
broad topical area for only these five groups.*^ 



^^When non-redundant counts of journal titles are made over the five 
groups for each topic (125 journals) only a slightly different picture 
emerges with respect to topics. To cover the sample of 125 articles on 
counseling, one must consult 70 different journals, while 76 journals 
must be consulted on curriculum, 82 on employment, and 87 on attitude. 
Again, a chi square test against the hypothesis of equal expected jour- 
nal title frequencies, leads to acceptance of the "no difference" hypo- 
theses* The amount of redundency over the five groups may be gauged by 
comparing the average of 78.75 journal titles for these four non-redundant 
counts with the redundant count estimate of 90.0 journal titles per topic 
(S groups by 18.00 journals per group). 

^^Ninety percent coverage of the 20 samples involved in this study (four 
topics, five groups) would require access to 164 journals. Recall that 
less than one third of the journal literature posted to the five groups 
is covered by these four topics. It becomes obvious that, given the 
highly dispersed nature of educational journal publication, only a very 
few libraries or information services can afford to maintain subscrip- 
tions to the number of journals needed to provide immediate access to 
large proportions of the CIJE literature posted to special groups. 
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TABLE 10 



UNWEIGHTED MEANS ANALYSIS OF VARIANCE: LOGARITHM (BASE 10) FOR 
JOURNAL CIRCULATION FOR SAMPLES OF TWENTY TOPIC/GROUP COMBINATIONS 



Cell Weans and n' s 





PHYSICALLY 
HANDICAPPED 


HENTAUY 
HANDICAPPED 


SLACKS 


HISPANICS 


UOHEN 


Averages 


Mean 


ri 


Mean 


N 1 


Mean 


N 


Mean 


N 


htean 


N 


_AniTUDES 




23 


4.01 


24 


3.54 


23 


3.37 


21 


3.90 


24 


3.71 


EMPLOYMENT 


3.84 


24 


3.99 


24 


3.99 


23 


3.67 


20 


3.71 


22 


3.84 


COONSEITKG 


3.67 


25 


4. ID 


23 


3.83 


?3 


4.02 


22 


3.63 


22 


3.85 


CtJRRtCtJLtJM 


3.91 


8 


4.D4 


23 


4.D7 


21 


3.92 


19 


3.78 


22 


3.94 


Averages 


3.79 


4.D4 


3.86 


3.74 


3.76 


3.84 



Stunnary of Analysis of Variance^ 



Source of Variation 


SS 


df 


MS 


F 


P level 


Topics 


2.803 


3 


0.934 






Groti^ 


4.692 


4 


1.117 






Interactfon 


7.4t6 


12 


D.618 


2.15 


p<,05 


Uithin Ce?1 


??9.313 


416 


D.287 







^Harmonic mean of cell frequencies = 20.5714 
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4. Journal circulation . In the immediately previous section, 
we addressed the question of; How many different journals would one 
need to read to cover the sampled literature? In this section we 
would like to turn the question around to ask; How many persons 
might have read the sampled literature? Because some journals are 
read by more than one person, but not every reader will read all the 
articles in every issue, we have no reliable basis for answering the 
readership question. However, readership may be approximately pro- 
portional to circulation, which we can estimate, at least roughly. 
This was done as follows. 

We first listed the journal titles for every article in the samples. 
The 483 articles in the samples are found in 212 journals* Of these 
2^? journals, 163 are currently listed in the CIJE Source Journal 
Index . The remaining 49 titles, not currently listed, represent jour 
nals that are either now defunct or that are not regularly searched. 
To est1;nate sample circulation, we began searching for the latest 
circulation data for all 212 journal titles by consulting a variety 
of sources (see page 12). Data on circulation was found for 181 
journals (85%). To estimate the circulation for each of the 20 
samples, the available circulation data for each journal title was 
matched to the article{s) in the samples. i^ Because the circulation 
distribution is highly skewed, with a range from five hundred to 
nearly two million, the raw circulation numbers were converted to 
logarithms {base 10) prior to running an unweighted means analysis 
of variance.'' The results of this analysis appear in Table 10. 
Given the significant interaction {P<.05K we did not list the Fs 
for main effects, but proceeded to individual tests of the simple 
effects* The results of these tests are displayed in Table 11. 

Table 11 indicates that the simple effects of topic differences is 
significant for the two ethnic groups--Blacks and Hispanics, but is 
not significant for the other three groups* Tests of differences 
among means show that the log average circulation for the Black 
curriculum sample (4*07) and for the Black/employment sample (3.99) 
are both significantly greater than for the Black/attitudes sample 
(3*54)*'^ The Hispanic/counseling sample circulation (4*02) is 



^^Due to multiple appearances of some journal titles, we were able 
to find a circulation number for 436 of the 483 articles in the 
sample (90%)* 

l^It IS again noted that this method assumes that missing data loss 
is essentially random. There is some evidence that this may be so, 
since a preliminary analysis based on 397 cases produced a grand mean 
(log 10) of 3*85 with a within cells mean square of 0*284* After 
finding data for 38 more cases the grand mean was 3*84 with a mean 
square error of 0*287* 

^'^The antilogs of these means are approximately 11,750 and 9,900 vs* 
3,470 circulation* Since a logarithmic transformation is involved, 
these values are geometric rather than arithmetic means of the sample 
circulation numbers* 
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TABLE 11 



TESTS OF SIMPLE EFFECTS FOR TOPICS AND FOR GROUPS: 
LOGARITHM (BASE 10) FOR JOURNAL CIRCULATION 





SS 


d.f. 


HS 


F 


P- level 


ToDic Effect for 
PHYSICALLY HANOICAPPEO 


0.695 


3 


0.232 


0.81 


NS 


MENTALLY HAKDICAPPEO 


0.142 


3 


0.047 


0.16 


NS 


8LACKS 


3.379 


3 


1.126 


3.92 


P<.01 


HlSPANICS 


5.194 


3 


1.731 


6.03 


P<.01 


UOMEN 


0.808 


3 


0.269 


0.94 


NS 


Group Effect for 
ATTITUOES 


5.585 


4 


1.396 


4.86 


P<.01 


EMPLOYKENT 


1.868 


4 


0.467 


1.63 


NS 


COUNSELING 


3.551 


4 


0.888 


3.09 


P<.05 


CURRICULUH 


1.105 


4 


0.276 


0.96 


NS 


Ulthin Cell 


119.313 


416 


0.287 







significantly higher than the Hispanic/emplqyment (3.67) or the 
Hispanic/attitude (3.37) samples. The Hispanic/curriculum circulation 
3.92) is significantly higher than the Hispanic/attitude circulation 
3.37). {Note, this last difference parallels that obtained for Blacks.) 

The tests of the simple effect of group differences on topics also 
yielded two significant results. There are significant differences 
among groups for attitudes (P<.01) and for counseling (P<,05), but 
not for the other two topics. Tests of means show that for attitudes, 
the circulation means for mentally handicapped (4.01) and women (3.90) 
are both significantly greater than the means for Blacks (3.54) and 
Hispanics (3.37). The mean for physically handicapped (3.74) is also 
greater than the mean for Hispanics. 

For the counseling topic, the means for both mentally handicapped 
(4.10) and Hispanics (4.02) are significantly greater than the means 
for Physically handicapped (3*67) and for women (3.63). 
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rnspection of these differences among means for simple effects shows 
thdt most of them consist of combinations Involving the attitudes and 
counseling topics. When these topics are omitted (1.e.» only circu- 
lation data for the five groups in combinations with employment and 
curriculum are considered) an analysis of variance of this reduced 
set of data shows no interaction effect and no difference between the 
two topics* but a significant differences for the group main effects 
with the circulations for the mentally handicapped {^.02) and Blacks 
(4.03) much larger than the circulation for Hispanics (3.80) and 
woiiron (3.74). The circulation for physically handicapped is inter- 
mediate (3.88). Although this is a simpler set of results, it is 
achieved by considering only two of the four topics, and even in this 
case one must still consider differences among the groups. We con- 
clude that estimates of circulation are perhaps most safely made by 
considering each group/topic sample separately. 

Although logarithms provide an appropriate transformation for testing 
differences, they are harder to interpret since they represent geomet- 
ric means rather than arithmetic means of the original data. Unfor^ 
tunately* arithmetic means provide poor estimates due to the presence 
of a few extreme values, e.g., when one journal with a circulation of 
1,810,000 is added to nineteen values averaging 10,000, the mean jumps 
from 10,000 to 100»000. To avoid this kind of distortion. Table 12 
displays the circulation quartiles for each sample. The upper figure 
in each cell is the upper quartile and the lower figure is the lower 
quartile. The middle figure is the median. Half of the journals 
included in each sample have circulations within the range of the 
upper and lower figures. A fourth of the journals have circulations 
greater than the upper figure, and a fourth have circulations that 
are less than the lower figure. 



We shall examine some, but not all, of the significant s 
differences previously identified. Focusing on the medi 
perhaps more clearly the basis for the significant simpl 
topics in the Hispanic and Black columns. For Hispanics 
circulation for attitude journals is on 2,500 while it i 
curriculum journals, nearly a ten-fold difference. For 
attitude circulation median {3J00) and counseling media 
are much below the medians for the curriculum (13»500) a 
(12,700). 



imple effect 
ans, we see, 
e effects for 
the median 
s 24,000 for 
Blacks the 
n (4,000) 
nd employment 



For group simple effects, the differences among groups are statistic- 
ally most significant for attitude, where the circulation medians for 
mentally handicapped (11,500) and women (10,000) are much larger than 
those for journal literature posted to Blacks (3,100) and Hispanics 
(2t500). Counseling is the other topic that exhibited a significant 
simple effect for groups. Here, the medians for Hispanics (13,000) 
and mentally handicapped (11,600) are obviously much larger than 
those for women (3,500) and physically handicapped (3,000). 

To suNrmarize, the analysis of variance results indicate that there is 
a significant interaction effect that precludes making main effects 
cofnparisons of journal circulation data for topics or for groups. 
Tests of simple effects show that there are significant differences 
between groups for the attitude topic and for the counseling topic. 
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and that there are also significant differences between topics for 
the Black group and for the Hispanic group. The specific pairs of 
significant cell differences were Identified. 



TABLE 12 

JOURNAL CIRCULATION QUARTILES FOR TWENTY SAMPLES 
(CIRCULATION IN THOUSANDS) 





PHYSICALLY 
HANDICAPf>£D 


■1 

MENTALLY 
HANDICAPPED 


BLACKS 


HI SPAN ICS 


HQHEN 


AHITUDES 


8.0 

3.0 

3.0 


11.6 

11.6 

11.6 


6.3 

3.1 

1.6 


3.6 

2.6 

1.2 


26.0 

10.0 

1.8 


EMPLOYMENT 


26.0 

3.4 

3.0 


12.0 

11.6 

7.0 


26.0 

12.7 

2.4 


16.4 

4.8 

1.6 


12.7 

6.2 

1.8 


COUNSELING 


7.1 

3.0 

3.0 


18.0 

11.6 

11.6 


18.0 

4.0 

1.6 


24.0 

13.0 

3.6 


9.0 

3.6 

1.8 


CURRICULim 


40.0 

8.6 

1.6 


12.0 

12.0 

6.0 


, 

36.0 

13.6 

3.1 


30.0 

24.0 

1.8 


16.6 

6.0 

2.0 
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5* Clearinghouse distH button * This last section on the journal 
analysis looks at the ERIC Clearinghouses that accessed, abstracted, 
and indexed the journal articles contained in the samples. Over the 
eleven year period (1969-1979) twenty-three clearinghouse codes are 
represented, including all sixteen of the current ERIC Clearinghouses 
(CHs). To simplify the presentation, we have merged data from earlier 
and current CHs to correspond to current CH assignments.*^ 

Given that there is a Counseling and Personnel Services CH, we would 
expect to see maoy of the journals of the counseling topic handled 
by this clearinghouse. Much of the employment literature might be 
handled by this CH or the Adult, Career and Vocational Education CH. 
We would also expect to see Reading and Communication Skills CH well 
represented for curriculum topics. It may be less obvious where the 
attitude literature would be processed; perhaps Counseling and Per- 
sonnel Services and the CHs that tend to deal with special groups. 
Which CHs are these? Certainly, the Handicapped and Gifted CH might 
be expected to process much of the literature for the handicapped; 
the Urban Education CH might process some literature on Blacks and 
Hispanics, and the Rural Education and Small Schools CH might also 
process literature on Hispanics. There is good reason then to expect 
quite disproportional representation among the clearinghouses. But 
what does the distribution look like? Are there aoy surprises? 
Table 13 displays the data for the five groups, and Table 14 displays 
the data for the four topics. To facilitate comparisons, frequencies 
have been converted to percentages, expressed as the percentage of all 
journal articles for the group or the topic that were processed by 
the clearinghouse. Clearinghouses are listed, highest to lowest, by 
the overall percentage of journals in the total sample. 

We first note that four clearinghouses account for approximately two- 
thirds of the sample of 483 journal articles, and seven CHs account 
for over eighty percent of the total sample. However, all sixteen 
Clearinghouses are represented. Given the choice of counseling as 
one of the four topics, it is not too surprising that the Counseling 
and Personnel Services CH {CG} should head the list, by processing 
approximately a quarter of all the journal articles. Table 14 shows 
that sixty percent of the counseling topics were processed by the CG 
clearinghouse. The surprise here may be the fact that as much as 
forty percent of the journals on this topic were processed by other 
CHs, CG is also one of the major contributors to the attitude and to 
the employment literature in these samples. CG processed half of all 
the physically handicapped articles, over a third of all the women's 
articles, approximately a fifth of the Black and Hispanic articles, 
but only eight percent of the articles dealing with the mentally 
handicapped. 



^^Specifically, in terms of CH codes, articles processed by AC and 
VT were assigned to CE; AL to FL: LI to IR; and RE and TE to CS. 
Data on AA (LEASCO) was retained since there is no obvious assignment. 




TABLE 13 



percentages of cue journal articles for each of five groups 
pTOFssed by eric clearinghouses 





PHYSICALLY 
HANDICAPPED 


HENTALLY 
HANDICAPPED 


BLACKS 


HISPANICS 


WOMEN 


AU 

GROUPS 


CUH 
X 


ERIC CLEARINGHOUSE 


Code 


N«83 


N-100 


N-100 


N-100 


K-lOO 


K-483 




Counseling and 
Personnel Services 


CG 


SIX 


8X 


21X 


18% 


37X 


26. IX 


26.1 


Handicapped and 
Gifted Children 


EC 


11 


77 


3 


0 


0 


18.4 


44.5 


Urban Education 


UO 


0 


1 


32 


21 


4 


12.0 


56.5 


Adult* Career* and 
Vocational Education* 


CE 


23 


4 


10 


5 


10 


9.9 


66.4 


hural Education and 
Small Schools 


RC 


2 


0 


1 


27 


4 


7.0 


73.4 


Higtter Education 


HE 


1 


0 


3 


3 


14 


4.3 


77.7 


Social Studies/Social 
Science Education 


SO 


0 


0 


5 


7 


2 


2.9 


80.6 


Teacher Education 


SP 


6 


3 


1 


1 


1 


2.3 


82.9 


Heading and Convnuni- 
catlon Skills 


CS 


1 


1 


3 


1 


5 


2.3 


85.2 


Elementairy & tariy 
Ch11dhor>d Education** 


PS 


0 


1 


3 


1 


4 


1.9 


87.1 


languages and 
llngul sties 


FL 


0 


0 


1 


3 


3 


1.4 


88.5 


Educational Management 


EA 


0 


0 


2 


3 


1 


1.2 


89.7 


Junior Colleges 


JC 


0 


0 


2 


2 


2 


1.2 


90.9 


Science. Mathematics & 
Environmental Education 


SE 


0 


1 


0 


1 


3 


1.0 


91.9 


Tests, Measurement* 
and Evaluation 


TM 


0 


1 


2 


0 


2 


1.0 


92.9 


Information Resources 


IR 


1 


1 


1 


1 


0 


0.8 


93.7 


Not Assigned (lEASCO) 


AA 


4 


2 


10 


6 


8 


6.0 


99.7 


Total 


100 


100 


100 


100 


100 


99.7 





•formerly CAREER EOUCATION 
••fonnerly EARLY CHILDHOOD EOUCATION 
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The major processor of articles for the mentally handicapped (77%) 
Is, of course, the Handicapped and Gifted Children (EC) Clearinghouse. 
However EC deals almost exclusively with this one group; accounting 
for little or no articles dealing with women, Hispanics or Blacks; and 
surprisingly few articles for the physically handicapped. We have 
just noted that CG, not EC, is the primary processor for the physical- 
ly h^ndicappedt while EC is the primary processor for the mentally 
handicapped. 20 Table 14 indicates that EC rather evenly spans the 
full spectrum of topics regarding the mentally handicapped. 

The Urban Education (UD) Clearinghouse, not surprisingly, is an espe- 
cially heavy processor for both minority groups (Blacks 32%; Hispanics 
21%). Table 14 indicates that this literature is especially concerned 
with employment, but also with attitudes and curriculum. (Most of the 
counseling literature for Blacks and Hispanics is processed by CG.) 

The other major processor for Hispanic literature is the CH on Rural 
Education and Small Schools (RC), which processed 27 percent of the 
Hispanic sample of journal articles (dealing primarily with Mexican 
Americans). 

The Adult, Career and Vocational Education (CE) Clearinghouse tends 
to mirror the Counseling and Personnel Services (CH) (at approximately 
half the percentages) in processing journal articles for all five 
groups; and, again like CG, especially heavily for the physically 
handicapped. This CE literature is primarily concerned with employ- 
ment, but the other three topics are also represented. 

The remaining clearinghouses each contribute less than five percent 
to the total sample. 

Focusing now on the groups listed in Table 13, we see three clearing- 
houses (CG, 51%; CE, 23%; and EC 11%) account for 85 percent of all 
the journals on physically handicapped. As noted before, over three- 
fourths of the mentally handicapped literature is processed by EC. 
More than sixty percent of the literature for the two minorities and 
for women is processed by just three clearinghouses: For Blacks (UD, 
32%; CG, 21%; CE, 10%); for Hispanics (RC, 27%; UD, 21%; CG, 18%); 
for women (CG, 37%; HE, 14%; CE, 10%). 

Turning to Table 14 to see where topics are processed, we see that 
just two clearinghouses (CG, 60%; EC, 16%) account for almost two- 
thirds of the counseling articles. The literature dealing with the 
other three topics is more dispersed. Four clearinghouses (EC, 21%; 
CG, 20%; UD 14%; and RC, 10%) processed 65 percent of the attitude 
articles, and four clearinghouse (CE, 23%; CG, 18%; UD, 18%; EC 17%) 
processed 76 percent of the employment articles. Every clearinghouse 
made some contribution to the curriculum sample, with EC (20%), UD 
(12%), and HE (9%) processing the largest proportions. 



20Members of the ERIC system would not be surprised by this result, 
but it might surprise the average ERIC user to discover that the 
Handicapped and Gifted Clearinghouse does not access much of the 
literature for the physically handicapped. 



TABLE 14 



percentages of cue journal articles for each of four topics 
pTOTssed by eric clearinghouses 





ATTITUDES 


£M?LOVMEHT 


COUNSELING 


CURRICUIUM 


ALL 

TOPICS 


ERIC CLEARINGHOUSE 


Code 






H-12S 


N«108 


N-483 


counseling and 
Personnel Services 


CG 


20 


18 


60 


3 


26,1 


Handicapped and 
Gifted Children 


EC 


21 


17 


16 


20 


18.4 


Urban Education 


UO 


14 


18 


S 


12 


12.0 


Adult. Career, and 
Vocational Education* 


CE 


4 


23 


6 


6 


9,9 


Rural Education and 
Small Schools 


RC 


10 


8 


4 


6 


7.0 


Hlqlier Education 


HE 


0 


6 


2 


9 


4.3 


Social Studies/social 
Science Education 


SO 


4 


2 


0 


D 


Z>9 


Teacher Education 


S? 


2 


2 


1 


5 


2.3 


Read1n9 and Conaminl- 
catlon Skills 


CS 


S 


1 


1 


3 


2.3 


Elementary & Lariy 
Childhood Education** 


PS 


5 


0 


1 


2 


1.9 


Lan9ua9es and^ 
Linguistics 


FL 


2 


1 


0 


4 


1.4 


Educational Management 


EA 


1 


2 


0 


3 


1.2 


Junior Colleges 


JC 


1 


0 


0 


5 


1.2 


Science* Mathematics & 
Environmental Education 


SE 


2 


0 


0 


3 


1.0 


Tests, Measurement* 
and Evaluation 


TM 


3 


0 


0 


1 


1.0 


Information Resources 


IR 


1 


1 


0 


2 


0.8 


Hot Assigned (LEASCO) 


AA 


8 


2 


4 


10 


6.0 


Total 


103 


101 


100 


100 


99.7 



*fonnerly CMtEER EOUCATION 
'Monoerly EMLY CHILOHOOO EDUCATION 
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In ^jenoral , these results make senso* Mthough the counseling Uter- 
aturo has been assigned primarily, but hardly exclus-Ively, to one CIU 
thore is no such specialisation for the other three topics; although 
ono of the reasons that CC appears so high on the list is due to its 
heavy contribution to processing the employment literature* The other 
top Clls tend to appear high In Table 14 primarily because of their 
high positions in processing Journal (irticles for ono or more groups 
(f?.;]'. CG for physically handicapped and for women; EC for mentally 
handicapped; UO for Blacks; RC and UO for Hispanics)* The reader 
should note that the choice of special groups and of topics is 
responsible for the particular results displayed in Tables 13 and 
Mt Other groups and other topics could produce decidedly different 
ordorings among the clearinghouses. 21 However, the general pattern 
for any heterogenous choice of groups and topics is probably evident. 
There will be disproportional contributions; typically only a few 
clearinghouses will account for the major portion of the literature; 
but most of the clearinghouses may be represented* 

6* $ummaj:y of CIOR content analysis * The CUE journal samples 
display significant group or topic differences in every area we exam 
inedi namely: average date of publication, average page length, number 
of journal titles represented in the samples, sample circulation size, 
and clearinghouse distribution* 

With publication dates ranging from 1969 to 1979, the average CUE 
article in the total sample is early 1974; however, the publication 
dtite averages for women and for physically handicapped are at least 
a year more recent than the averages of the other three groups* Over- 
all, CUE articles average approximately seven pages in length* How- 
ever the articles for both handicapped groups average less than six 
pages, while those for Mispanics and women average over eight pages* 
Articles on counseling topics average approximately six pages, but 
those for employment topics average over eight pages* 

There are substantial differences in how many journals are represented 
in these samples and also in how widely they are circulated* General- 
ly, the journal literature in the field of education is highly dis- 
persed* This is certainly true for most of these group/topic samples* 
The 483 CUE articles included in this study were found in over two 
hundred different journals* Typically, one would need to subscribe to 
six or seven journals per group/topic combination in order to find 
even half the articles in each sample of 25 articles* However there 
is a wide range (2 to 13 journal titles) to achieve "50% coverage*** 
To cover all 25 articles in each group/topic sample, one must consult 
R to different journals. There are also vast differences in circu- 
lation size* A significant topic by group interaction effect makes it 
difficult to generalize concerning overall circulation or concerning 



'^Ipor example, omitting the mentally handicapped group would most cer- 
tainly cause EC to drop toward the very bottom of the list* Adding a 
topic such as assessment and testing would most certainly move TM 
toward to top of the list* 
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differences among topic or among groups* Moreover, the extreme dff- 
Terences among circulation figures for Individual journals (500 to 
1,800,000) tend to seriously distort the arithmetic averages* Median 
circulations for the 20 topic/group samples range from 2,500 to 24,000, 
indicating that there are vastly different levels of circulation* 

Finally, we noted the proportion of the journal articles that were 
processed by the 16 Current ERIC clearinghouses or their respective 
predecessors* Given the specialization of the clearinghouses, and 
the specific topics and groups that were considered In these CIJE . 
samples, It comes as no surprise to find greatly different proper^ 
tional contributions* In fact two-thlrds of the total sample of 
articles were processed by only four clearinghouses, but all sixteen 
clearinghouses are represented In the sample. Despite the heavy 
concentration in a few clearinghouses, it should be noted that in 
only one group (the physically handicapped) and in only one topical 
area (counseling) does a single clearinghouse process as much as 
half the articles included in these samples. 

F. RIE Content Analysis Results for Group Differences 

1* Introduction . Because many more variables were coded (see 
page 14) in the content analysis of Research In Education f RIE ) 
documents, the results of the RIE analysis are much more extensive 
than those reported In the prevTous section on CIJE articles* We 
shall begin with an examination of two continuous variables that 
were examined by analysis of variance. The variables are: year 
of publication and page length. For these variables, a two-way 
analysis of variance (4 groups by 5 topics) was performed, using the 
unweighted means procedure to handle missing data. 

We shall then examine differences among the five groups on several 
"qualitative" variables: These include: type of sponsor, type of 
performer, publication type, microfiche and hardcopy availability, 
sex of all authors, and number of equity groups identified in 
citation/abstract. These differences will be presented in the form 
of cross tabulations that were tested by chi square tests. Where 
significant chi squares are found, the adjusted residuals of cells 
are computed and reported. 

In the following section {Section G), we shall examine the inters 
relationships among a number of variables including: topic content 
area, semi-decade of publication, sponsor type, performer type, 
publication type, availability in microfiche or hardcopy, authors* 
sex, number of equity groups identified, and page length. 

2. RIE Publication dates . Table 15 displays the means and 
analysis of variance results with respect to RIE publication dates. 
In this analysis, there is no evidence for an interaction effect or 
for a main effect with respect to topics. There is a significant 
effect for groups. Tests of differences among the averages over 
topics for groups {bottow row of cell means table), indicates that 
the women's RIE document literature is significantly more recent 
(74.12) than that of any of the other four groups, while the RIE 



document literature for the mentally handicapped (70.81) is sig- 
nificantly older than that for the physically handicapped (72.67) 
or for women (74.12). 



TABLE 15 



UNWEIGHTED MEANS ANALYSIS OF VARIANCE: PUBLICATION DATES (MINUS 1900) 
FOR RIE QOCUMENTS FOR SAMPLES OF TWENTY TOPIC/GROUP COMBINATIONS 



Cfit Means and N's 





PHYSICALLY 
HANDICAPPED 


HENTALLY 
HANDICAPPED 


BLACKS 


HI SPAN I OS 


W0ME^ 


1 


Averages 




Mean 




Mean 


N 


Mean 


N 


Mean 


H 


Mean 


U 




ATTITUDES 


7?.40 


?5 


70.88 


2S 


7? .04 


2S 


71.80 


2S 


73.7? 


?S 


7?. 168 


EHPLOVHENT 


7?. 88 


?S 


71.40 


2S 


73.1? 


2S 


71.9? 


2S 


74.60 


?S 


7?.784 


COUNSELING 


7?. 3;? 


?5 


69.68 


2S 


71.40 


2S 


70.84 


?5 


73. S? 


?s 


71. SS? 


CUftl?ICULUH 


73.08 


?5 


71.?8 


2S 


71.1? 


2S 


71.60 


?S 


74.64 


?5 


7?. 344 


Averages 


7?. 67 


100 


70.81 


100 


71.9? 


100 


71.54 


100 


74.1? 


199 


7?.?1? 



Source of Variation 


SS 


df 


MS 


F 


P level 


Topics 


96.09 


3 


3?. 03 


1.63 


NS 


Groups 


633. S9 


4 


158.40 


8.05 


P<.001 


Interaction 


61.7? 


1? 


5.14 


0.?6 


NS 


Within Cell 


9,445. 44_ 


490 


T9.6d 







*Hannonic mean of cell frequencies * ?5. There are no missing data for this 
variable. 
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3. RIE document page length . Table 16 displays the results of 
tho analysis for page length. Here again there is no evidence for an 
interaction effect. But the topic main effect is significant, while 
there is no significant main effect for groups. 22 in this Instance we 
should focus on the average, over groups, displayed 1n the right margin, 
Thoy indicate that, while RIE attitude documents average approximately 
83 pages, the employment documents average approximately 132 pages. 
Tests, of the differences for these averages indicate that there is a 
significant difference between these two extremes, but neither is 
significantly different from the intermediate averages for counseling 
(approximately 105 pages) and curriculum (approximately 108 pages). 

TABLE 16 

UNWEIGHTED MEANS ANALYSIS OF VARIANCE: 
RIE DOCUMENT PAGE LENGTH FOR SAMPLES OF TWENTY TOPIC/GROUP COMBINATIONS 

Cell Heans and N' s 





PHVSKALLV 
HANDICAPPED 


MENTALLY 
HANDICAPPED 


BLACKS 


HISPANICS 


WOHEN 


Averages 


Kean 


N 


Mean 


N 


Mean 


N 


Mean 


N 


Mean 


N 


ATT1TU0E5 


70.63 


23 


110.46 


23 


99.32 


25 


65.42 


24 


66.56 


25 


82.52 


EMPLOYMENT 


145.46 


25 


107.32 


_ 25 


132.52 


25 


161.04 


23 


113.04 


25 


131.86 


COUNSELING 


132.46 


24 


106.91 


_ 22 


64.21 


24 


96.20 


25 


101.96 


25 


104.75 


CURRICULUM 


147.63 


24 


116.12 


24 


97.91 


23 


74.92 


25 


102.64 


25 


108.33 


Averages 


124.15 




110.71 




103.49 




99.90 




96.10 




106.87 



5ource of Variation 


55 


df 


M5 


F 


P level 


Topics 


148*009. 


3 


49.336. 


4.13 


P<. 01 


Groups 


47.299. 


4 


11 .625. 


0.99 


N5 


Interaction 


143.548. 


12 


11.962. 


1.00 


NS 


Within Cell 


5,538*929. 


464 


11.937. 







*Hannon1c mean of cell frequencies ■ 24.1633 



22a three-way analysis of variance (4 topics by 5 groups by 5 accession 
blocks of 5 documents each) was also run. Since there v/as no significant 
interaction Involving accession blocks and no significant main effect for 
accession blocks, the results of this more complex analysis are not pre- 
sented. The lack of significant effects for accession blocks means that 
there is no evidence, at least for these 20 samples, that would indicate 
that average RTE document length has varied appreciably over the history 
of the ERIC system {more than 15 years). A similar three-way analysis for 
publication date yields spurious results since publication date and acces- 
sion order are very highly correlated. 
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The next several sections deal with nominal variables which were cross 
tabulated, and then tested by chi square analyses. 

4. Type of sponsor . Table 17 displays the frequency counts, 
adjusted residuals, and significance levels for the cross tabulation 
of groups with type of sponsor. 

The right margin of Table 17 displays the number and percentage of 
the 500 RJUE documents, classified by type of sponsor. Since RI£ 
routinely acquires the final and other significant reports of nearly 
all federally-sponsored research in education, it is not surprising 
that federal sponsors account for the largest portion (43%) of RI E 
documents. Ame^ng other types of sponsors, the next largest sponsor 
type is state/local education agencies (10%). then publishers (7%), 
foundations and other agencies (7%), and state agencies other than 
state education agencies (2%). Nearly one-third (31%) of the RIE 
docurnent samples could not be identified as to sponsor. (This is 
especially true for speeches and presentations at meetings.) 

Because there are exactly 100 documents in the sample for each of the 
five groups, the cell frequencies may be read as percentages for each 
group. For example. 55 percent of the physically handicapped docu- 
ments were federally sponsored, while only 29 percent of the Blacks 
documents were federally sponsored. Given a highly significant chi 
square test (p<.001), adjusted residuals were computed. The adjusted 
residuals associated with these two cells are both significant 
(** = P <.05) indicating a higher than expected value (+2.7) for 
the physically handicapped and a lower than expected value (-3.2) 
for Blacks. 

The frequencies for Hispanics and for women display no significant 
discrepancies, i.e., the actual frequencies are close to the expected 
frequencies. (This can be verified by comparing cell values (with 
corresponding percentages in the total column). Sponsorship for the 
other three groups deviates from the expected. For the physically 
handicapped, we find significantly higher than expected sponsorship 
by federal and other (noneducational) state agencies, but a lower 
than expected number of documents with no identifiable sponsorship. 
For the mentally handicapped, we find higher than expected numbers 
of documents sponsored by state/local education agencies and pub- 
lishers, but fewer than expected documents sponsored by foundations 
and "other" types of sponsors. For Blacks, we find fewer than 
expected documents indicating federal sponsorship and more than the 
expected number of documents with no identifiable sponsor. 

5. Type of performer . As noted previously, the institutional 
affiliation of the first author was used to classify documents in 
terms of the type of institutional performer of the work resulting 
in the RIE_ document. Table 18 displays the results of the cross 
tabulation of groups by type of performer. We first note that the 
chi square test for this table is highly significant. (This will be 
considered later.) We see (right margin) that first authors of RIE 
documents are most frequently associated with universities (43%). 
Local agencies (usually school districts) and non-profit/for-profit 
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TABLE 17 

CROSS TABULATION FREQUENCIES AND ADJUSTED RESIDUALS: 
FIVE GROUPS BY SIX SPONSOR TYPES 
(X2 = 51.27; P<.001) 





PHYSICALLY 
HANDICAPPEO 


MENTALLY 
HANDICAPPED 


BLACKS 


HISPANICS 


MDKEN 


Total 


FEOERAL AGENCY 


55 

+2.7** 


40 
-0.7 


29 

-3.2** 


45 
+0.7 


45 

+0.4 


214 
{43X) 


STATE OR LOCAL 
EDUCATION AGENCY ' 


10 

+0.1 


15 

+2.0** 


10 

+0.1 


8 

-0.6 


8 

-0.6 , 


51 

dot) 


PUBLISHER 


6 

-0.5 


16 

+3.8*"* 


5 

-1.0 


6 

-0.4 


3 

-1.8 


36 
(7%) 


FOUNOATIONS AND 
OTHER AGENCIES 


4 

-1.3 


2 

-2.1** 


11 

+1.8 


10 

+1 .5 


7 

+0.1 


34 
{7%) 


OTHER STATE AGENCY 


5 

+2.1** 


2 

-0.2 


1 

-0.9 


2 

-0.1 


1 

-0.9 


11 

{«) 


NO SPONSOR IDENTIFIED 


20 

-2.7** 


25 

-1.4 


44 

+3.1** 


29 

-0.3 


36 

+1.2 


)54 
(31X) 


Total 


100 


100 


100 


100 


100 


500 



62 
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organiztitions each contribute 15 or 14 percent. State agencies (usu* 
ally the state educational agency); federal agencies; associations, 
councils and comnilsslons; and publishers each contribute 6 to 8 per- 
cent. The remaining 16 documents (approximately three percent) include 
six thot were produced by foundations, and ten documents that could not 
be clfissified. Neither group is large enough to include in the chl 
square test so they were omitted froni Table 18. For this reason, there 
tire fev/er than 100 documents for each group. Where percentages are 
different from the cell frequencies, the percentage appears in paren- 
theses in each cell. Cells where the actual frequency Is significant- 
ly different from the expected frequency are flagged by asterisks 
(** indicates P<.05; *** indicates P<.01) beside the adjusted residu* 
als. Positively signed adjusted residuals indicate the actual value is 
higher than the expected. Negatively signed residuals indicate the 
fictudl frequency is lower than the expected frequency. For example, 
there are 50 documents posted to women whose first author was univer- 
sity based (top left cell). Multiplying the corresponding marginal 
totals and then dividing by the grand total [(207 X 96)^484=41.06] we 
find that the expected frequency for this cell is 41.06. The actual 
frequency of 50 is approximately 9 higher. When the cell residual is 
'^adjusted*' (see Appendix B), we obtain an approximately standard 
normal variable of 2.1 which exceeds the value of 1.96 (the 97.5 per- 
centile of the standard normal distribution) and thus indicates that 
this discrepancy is significant (at the .05 level for a two-tail test 
of either positive or negative differences). 

There are 6 cells 1n the 35 cell table where the discrepancies between 
expected and actual frequencies are significant. For the physically 
handicapped, we find more than the expected number of non*prof it/for- 
profit organizations and few local agencies contributing to this lit- 
ature. For the mentally handicapped, we see that the actual frequen- 
cies are not significantly different from the expected for all bi^t 
one performer type: publishers are represented by 16 RIE documents 
on the mentally handicapped (whereas approximately seven would be 
expected). The Black literature shows no significant discrepancies. 
The Hispanic literature is marked by only one discrepancy: here there 
are only eight documents prodi^ced by first authors affiliated with 
non*prof it/for-profit organizations, while approximately 14 would be 
expected. We have already noted that there are significantly more 
documents in the women's sample that were produced by university 
affiliated authors. There are also significantly fewer documents 
that have been produced by authors associated with local (usually 
school district) agencies (7 actual vs. 14,08 expected). 

These significant cell discrepancies can also be viewed row-wise, 
e.g.j universities contribute 35 to 52 percent of the literature for 
each group, and significantly more (52%) to the women's literati^re 
than would be expected; non-profit/for-prof it organizations from 
eight to 23 percent of the literature for each group. The eight 
percent for Hispanics is significantly less than would be expected, 
while the 23 percent is greater than would be expected. Since this 
class of agencies depends primarily on external funding, the dif- 
ferences here probably reflect differences in sponsor funding. 
Referring back to Table 17, we see that federal sponsorship and 
**other'* state agencies are significantly higher than expected for 
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TABLE 18 



CROSS TABULATION FREQUENCIES AND ADJUSTED RESIDUALS: 
FIVE GROUPS BY SEVEN PERFORMER TYPES 
(X2 = 58.27; P<.001) 





PHVSICALLy 
HANDICAPPED 


HENTALLV 
HANDICAPPED 


BLACKS 


HISPANICS 


WOMEN 


Total 


UNIVERSITIES 


34 (35X} 
-1.7 


34 (35X} 
-).8 


41 (44X} 

+o.a 


48 (48X) 
+ 1.3 


50 (5ax) 
+a.i** 


a07 
(43X} 


HOH-PROFIT/FOR- 
PROFIT AGENCIES 


ZZ (33%) 
+3.7** 


10 

-1.3 


la (13X} 

-0.5 


8 

-a.o** 


17 (18X) 

+1.1 


69 
(14X} 


LOCAL AGENCIES 


8 

-a.o** 


19 

+ 1.5 


18 (19X} 
+ 1.4 


19 

+1.4 


7 

-2.3** 


71 
(15X) 


STATE AGENCIES 


la 

+ 1.9 


■^1.8 


4 

-1.4 


7 

-0.3 


3 

-1.9 


38 

m 


FEDERAL AGENCIES 


6 

-0.1 


4 

-1.1 


6 

0.0 


6 

-o.a 


9 

+ 1.3 


31 

(6X} 


ASSOCIATtOrtS, COUNCILS 

& cowissiorts 


9 

+ 1.0 


3 

-1.7 


8 

+0.6 


7 

0.0 


7 

+0.1 


34 
(7X) 


PUBLISHERS 


6 

-0.4 


16 

+4.0*** 


5 

-0.7 


4 

-1.3 


3 

-1.7 


34 
(7X) 


Total 


97 


98 


94 


99 


96 


484 
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the physically handicapped sample; however, federal (or other types 
of sponsorship) are not significantly discrepant for Hispanics. 

Loco! agencies contribute less than expected to the physically handi- 
capped and to women* s literature. State agencies, federal agencies, 
and the combination of associations, councils and commissions, are 
undifferentiated— they contribute about the expected amounts to each 
of the five groups. Finally, we see that nearly half (16) of all 
(34) publisher's documents fusally b^oks) are part of the literature 
on the mentally handicapped/ retarded. With the exception of this 
]ast discrepancy, none of the significant discrepancies are remarkably 
large. Perhaps it is more remarkable that in 29 of the 35 cells, 
there are no significant discrepancies. 

We conclude that different types of performer institutions do contri- 
bute in somewhat different ways to the literature represented in the 
samples for these five groups. However, although these are statis- 
tically significant discrepancies, in no case is there a cell percen- 
tage which is more than nine percentage points lower or higher than 
the right margin percentages (total for five groups). The largest 
differences in the entire table show university-based authors produ- 
cing 35 percent of the literature for both handicapped groups, while 
they produce 52 percent of the literature In the women*s sample. 

6. T^pe of document . Table 19 displays the cross tabulation 
results for the five groups and for nine inclusive classifications 
of publications. Again, there is a highly signficant chi square 
test, indicating that there are signficant differences across the 
five groups in the types of publications that appear in their samples 
of RIE documents. The publication types have been arranged in descen- 
ding order of total frequencies of appearance in the overall sample 
of 500 documents. Because there are exactly 100 documents for each 
group, the cell frequencies are also i nterpretable as percentages 
totaling to lOO over the nine publication classifications. Research 
reports (technical reports, studies) is the largest single type of 
publication, accounting for 28 percent of the total sample, with a 
rdnge from 20 percent for physically handicapped to 37 percent for 
women. Both the adjusted residuals for these two extremes Just 
exceed the .05 signficance level, indicating that there are signfi- 
cantly fewer than the expected number (28.4) of research reports for 
the physically handicapped and significantly more for women. This 
difference (37% vs. 20%) is the largest to be found in the table. 

Project/program descriptions (implementation efforts, evaluations) 
constitute the next largest group of documents, accounting for IB 
percent of the sample. All five groups are rather evenly represented 
by this type of publication. There are no significant discrepancies 
between actual and expected frequencies. 

Speeches (including conference reports, "Papers presented at...", 
verbal presentations, etc.) is the third highest classification, 
representing 12 percent of all RIE documents in the combined sample. 
There is one signficant cell discrepancy indicating that the 20 
(percent) of all RIE documents in the Black sample in this class is 
significantly higher than the nurnber expected (12.4). 
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TABLE 19 

CROSS TABULATION FREQUENCIES AND ADJUSTED RESIDUALS: 
FIVE GROUPS BY NINE PUBLICATION TYPES 
(X2 » 80.38; P<.001) 





PHYSICALLY 
HANOI CAPPEO 


MENTALLY 
HANDICAPPEO 


BLACKS 


HI SPAN! CS 


WOffEN 


Total 


RESEARCH DEPORTS 


20 

-Z.O** 


2$ 

-0.6 


33 

+1.1 


26 

-0.6 


37 

+Z.1** 


14Z 

(ze.4X) 


PROJECT OESCRlPTIOtIS 
& EVALUATIONS 


ZO 

-^0,5 


le 

-0.1 


17 

-0.3 


Z3 

■^1.4 


13 

-1,5 


91 

(le.zx) 


SPEECHES 


7 

-1.8 


7 

-1.8 


20 

+Z.6** 


15 

+0.9 


13 

+0,Z 


62 

{IZ.4X) 


CURRICULUM MATERIALS 


14 

*1 fi 


15 


3 


6 

.1 3 

"I.J 


9 


47 

<9 4Xt 


BOOKS 


11 

+0,7 


11 

+0,7 


7 

-0.9 


1) 

+0.7 


6 

-l.Z 


46 

(9.ZX} 


CUIOES 


11 

+1.9 


13 

+z.e** 


2 

-2.1** 


3 

-1.7 


5 

-o.e 


34 

(6.8$} 


PROCEEOtNCS 


10 


4 

-0.6 


3 

-1.1 


6 

+0.4 


3 

-1.1 


26 

(5.2X) 


BIBLIOGRAPHIES. 
REVIEWS, LISTS 


6 

+0.7 


6 

+0.7 


1 

-1.9 


4 

-0.3 


6 

+0.7 


23 

(4.6X) 


OTHER nPES OF 
PUBLICATIOtIS 


1 


0 


14 

+3.9*** 


6 
+0.1 


e 

+1.1 


29 

(5.flX) 


Total 


100 


100 


100 


100 


100 


500 



er|c 
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Considering the fact that one of the four topics on which the samliles 
were structured Is curriculum. It my be surprising that only 47 
documents (9%) were actually curriculum materlals*^"^ Within this 
classification, we see that the mentally handicapped sample contains 
significantly more (15%) and the Black sample contains signficantly 
less (3%) than expected (g*4%)* 

The 46 books (monographs, textbooks, etc*) also constitute nine per- 
cent of the overall sample* All five groups are approximately evenly 
represented by this class of publication* 

Guides (teaching guides, resource guides, study guides, administrative 
guides, manuals) is the next largest class, representing seven percent 
of the sample* We see that mentally handicapped Is significantly lar- 
ger (13%) while the percentage for Blacks Is significantly smaller 
(2%) than the expected value (6*8%)* 

Proceedings (conferences* records, complete minutes of meetings) is 
seventh in this list of nine, and constltues five percent of the 
total sample. The ten (percent) of the physically handicapped sample 
in this class is nearly twice the expected value (5*2%)* 

Next to last in the list is bibliographies (Including annotated bib- 
liographies, book catalogues, abstracts, literature review, literature 
search/ guides, indexes, state of the art reviews, etc*)* Approximately 
five percent (4*6%) of the total sample is in this class* There are 
no significant discrepancies among the five groups, although only one 
item appears in the Black sample* 

The final classification Is a catchall that Includes: theses and 
dissertations, journals and serials, directories and questionnaires, 
and measurement devices* This miscellaneous category constitutes 
approximately six percent of the sample* The Black sample is heavily 
overrepresented (14% including: 9%, theses and dissertations; 5%, 
journals and serials), while both handicapped groups are signficantly 
underrepresented in this category* 

We leave to the reader to note for each group, how the literature is 
distributed by publication type and where there are signficant dis- 
crepancies* We note, however, that the two minority groups are 
remarkably different* The Hispanic group displays no significant 
discrepancies, while there are four signficant discrepancies for 
Blacks* 

We again note that, while the overall pattern is highly significant, 
few of the cell differences are truly extraordinary* The largest 
discrepancies are no more than inine percentage points of the 
right margin percentages* The RIE literature for the five groups is 



23as we shall see later, the 125 curriculum documents are distributed 
among all nine of the publication type classifications indicated in 
Table 19, with only 30 percent of the 125 classified as curriculum 
material s* 
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significantly different in the types of publications found, but few of 
these differences are especially large*24 



7* RIE document availability * One of the remarkable aspects of 
the ERIC RIE data base is that most of the documents can be obtained 
in microfiche or hardcopy forms from one of several central facilities 
(usually the ERIC Document Reproduction Service, but also National 
Technical Information Service, and University Microfilms)* Tables 20 
and 21 provide Information on the microfiche and hardcopy availability 
for the five equity groups* Since neither chi square Is significant, 
there is no evidence of major differences among the groups In terms 
of the availability of their RIE literature: 87 percent of the total 
sample is available in microfiche and 77 percent is available in 
hardcopy* The somewhat lower availability of microfiche documents 
for the mental! handicapped may be explained partially in terms of 
the relatively larger number (16%) of publishers (see Table 18) 
represented in this sample, who may prefer not to give copy releases 
for their publications* 

The impressive point about Tables 2D and 21 is that one can easily 
obtain copies of at least 8D percent (and sometimes as high as 90 
percent) of the RIE literature for any group In microform, and that 
one can usually obtain more than three- fourths of this literature in 
hard copy* 



TABLE 20 

CROSS TABULATION FREQUENCIES; 
FIVE GROUPS BY AVAILABILITY OF DOCUMENT IN MICROFICHE FORM 

(X^ = 6*D0; P=*20) 





PHYSICALLY 
HAKDICAPPEO 


HENTAUY 
HAKDICAPPEO 


BLACKS 


HISPANICS 


WOMEN 


Total 


MICROFICHE 
AVAILABLE 


90 


BO 


68 


B6 


90 


434 

(87%) 


MICROFICHE 
NOT AVAILABLE 


10 


20 


12 


14 


10 


66 
(13X) 


Total 


100 


100 


10O 


100 


100 


500 



^^The mentally handicapped and the Black groups present perhaps the 
most marked contrasts; especially with respect to speeches (7% vs* 
20%), curriculum materials (15% vs* 3%), guides (13% vs* 2%), and 
"other" types of publications (theses; journals) (0% vs* 14%)* 




TABLE 21 



CROSS TABULATION FREQUENCIES; 
FIVE GROUPS BY AVAILABILITY OF DOCUMENT IN HARD COPY FORM 

{X2 » 1.00; P».89) 





PHYSICALLY 
HANDICAPPED 


MENTALLY 
HANDICAPPED 


BLACKS 


HlSPANlCS 


WOMEN 


Total 


HARn COPY 
AVAILABLE 


78 


80 


77 


78 


74 


387 
(77t) 


HARO COPY 
NOT AVAILAftLE 




20 


23 


22 


26 


113 
{2^l) 


Total 


100 


100 


100 


100 


100 


500 



8. Author identity . In this section, we shall look for differ- 
ences in authorship of RIE documents among the five equity groups along 
two dimensions. First, what are the relative proportions of documents 
which have individuals identified as authors versus documents that show 
only corporate or anonyi^ous authorship? Second, where Individual 
author{s) are Identified, what are the proportions by sex? Tables 22 
and 23 display these data for the five groups. Table 22 indicates that 
there are significant differences among the five groups In the propor- 
tions of the samples of documents that are authored by identified per- 
sons as opposed to anonymous authorship* The samples for Blacks and 
women have significantly higher percentages of individual authors, while 
the handicapped samples, especially for the physically handicapped, 
show a larger percentage of ar\onymous authors* As we shall see, type 
of performer {e.g*, university vs* state educational agency) and type 
of publication {e*g., speech vs.* report of proceedings) account for 
these differences in author Identification. 

Table 23 looks at the 399 documents where the individual author(s) 
were identified to examine the sex of the first author. The highly 
significant chl square tells us that there are group differences. The 
adjusted residuals flag the women*s group as the significantly dis- 
crepant group. And we find almost a complete reversal in percentages. 
While 67X to 71X of the literature for the samples of the other three 
groups have a male first author, 6231 of the women's documents have a 
female first author*" There is no significant difference among the 
other four groups. 



25khen sex of first and second authors is considered, the pattern 
IS similar. Only 32 to 41 percent of the samples for handicapped 
or ethnic groups, where authors were identified, involved a woman 
as first or second author, while 69 percent of the women's sample 
involved a woman as first or second author. 



TABLE 22 



CROSS TABULATION FREQUENCII-S AND ADJUSTED RESIDUALS: 
FIVE GROUPS RY IDENTIFIED INDIVIDUAL AUTHOR VS. ANONYMOUS AUTHOR 

(X2 - 17.79; P<.002) 





PHYSICALLY 
HANOI CAPPEO 


MENTALLY 
HANDICAPPED 


BLACKS 


HI SPAN ICS 


WOMEN 


Total 


IDENTIFIED INDIVIDUAL 
AUTHOR (S) 


69 

-3.0** 


73 


B8 

+2-3** 


82 

+0.6 


B7 

+2.0** 


399 


ANONYMOUS AUTHOR 


31 

+3.0** 


Z7 

+ 1.9 


}Z 

-2.3** 


18 

-0.6 


13 

-2.0** 




101 
(20%) 


Total 


100 


100 


100 


100 


100 


500 



TABLE 23 

CROSS TABULATION FREQUENCIES AND ADJUSTED RESIDUALS: 
FIVE GROUPS BY SEX OF FIRST AUTHOR 
(X2 = 3.29; P<.001)* 





PHYSICALLY 
HANDICAPPED 


MENTALLY 
HANDICAPPED 


BLACKS 


HISPANICS 


WOKEN 


Total 


HALE FIRST AUTHOR 


46 

67% 

+0.9 


50 

68% 

+1.3 


62 

70$ 

+ 1.9 


58 

71t 

+ 1.8 


31 

36% 
-5.7*** 


247 

62% 


FEMALE FIRST AUTHOR 


23 

33% 

-0.9 


23 

32% 

-1.3 


26 

30% 

-1.9 


24 

29% 

-1.8 


56 

64% 
+5.7*** 


152 

38% 


Total 


69 


73 


88 


82 


B7 


399 



*When the women's group is omitted {X^ = 0.94; P = 0.38), 



ERIC 
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9. Number of equity groups identified . As we examined the 500 
iihstr<icts Included In the Rl_E samples, we noticed differences in the 
oxtent to which the documents focused exclusively on one group, dealt 
v/ith a few groups, or provided information on many groups* We thon 
coclod every document*s citation/ abstract into one of three classes: 
1) only one equity group is identified; 2) two or three groups are 
Identified; or 3) more than three groups are Identified* We recog- 
nized and counted a large number of special groups beyond the five 
thiit are the foctis of this study {e*g*, rural youth, Instltutional- 
iml, migrants, economically disadvantaged, American Indians, Asians), 
hut we counted synonymous or similar terms/identf f iers only once* 



TABLE 24 

CROSS TARULATION FREQUENCIES AND ADJUSTED RESIDUALS; 
FIVE GROUPS BY NUMBER OF EQUITY GROUPS IDENTIFIED 
(X2 • 31*21; P<*001) 





PHYSICALLY 
HANOI CAPPEO 


KNTALLY 
HANDICAPPED 


BLACKS 


HISPANICS 


WOMEN 


Total 


OttZ GROUP 


32 


6S 

+3.1** 


S2 

+0.2 


46 

-1.2 


61 

+2.2** 


2S6 

51X 


1W0 OR 1HREE GROUPS 


49 

+2.S** 


27 

-2.6** 


39 
+0.2 


42 

+0.9 


34 
-I. J 


191 

m 


MORE THAN THREE GROUPS 


19 

+3.0** 


8 

-0.9 


9 

-0.6 


12 

+0.6 


5 

-2.0** 


S3 

in 


lotal 


100 


100 


100 


100 


100 


soo 

100S 



Table 24 displays the results* Approximately half of the documents in 
the total sample focus on one group, but 38 percent Identify two or 
three different groups and 11 percent identify more than three groups* 
The highly significant chi square test indicates that there are signi* 
ficant differences among the five smples* Both the women's and the 
mentally handicapped samples display markedly higher than average focus 
on their one group, while the literature on the physically handicapped 
is characterized by higher than average treatment of several groups 
(typically describing several different physically handicapping con- 
ditions and sometimes discussing special conditions for women, minori- 
ties, the institutionalized, etc*)* 
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10. Summary of the RIE document analysis . The preceding analy- 
sis shows that the samples of RIE documents for the five equity groups 
are significantly different along a number of dimensions including: 
average age of the literature, sponsorship, type of Institutional per- 
former, type of document, authorship, and single/multiple group focus 
of the documents* contents. Only two characteristics showed no differ- 
ence among groups; average page length and availability In microfiche 
or hardcopy. 

As of early 1980, the average publication date for the £IE documents 
in these samples was early 1972, but the women's literature has a 
significantly more recent average (early 1974), while the mentally 
handicapped average Is significantly earlier (l^te 1970). The average 
length for all RIE documents in the sample is 107 pages. There are no 
differences for groups; however, document length does vary with topic, 
with an average of 83 pages for attitude topics and 132 pages for 
employment topics. 

Who sponsors the work reported in RTE documents, which types of insti- 
tutions perform the work, and what types of publications/formats it 
appears in, all vary significantly over the five groups. Overall, 
more than forty percent of the sample was federally sponsored, and 
federal, state, and local agencies together account for 55 percent of 
all documents. There are several differences among the samples of the 
five groups, e.g., a significantly higher proportion of documents in 
the women's sample are produced by university based authors; larger 
than expected amount of the physically handicapped samples are pro- 
duced by noi>prof it/for-prof it agencies; and publishers are notable 
contributors to the mentally handicapped sample. RIE contains a wide 
variety of types of documents. When classified by eight specific and 
one miscellaneous classifications, we find that over one- fourth of the 
documents are research reports. Research reports, project descriptions, 
and speeches constitute sixty percent of the total sample of 500 RIE 
documents. There are several significant differences among the groups 
in the percentage of documents that are of one type or another. For 
example, the women's sample contains almost twice the percentage (37%) 
of research reports when compared to the physically handicapped (20%). 
There are no overall differences among the five groups in availability 
in either microfiche or hardcopy forms. Over three- fourths of the 
sample can be ordered from central facilities (e.g., EORS, NTIS) in 
full-size hardcopy, and from 80 to 90 percent of the samples for the 
five groups are available in microfiche. 

The samples of documents for the five groups differ in their author 
identification, with substantially more individual authors for the 
women and Black samples, and a larger percentage of corporate (anony- 
mous) authorship for the handicapped. There is a complete sex reversal 
fn the authorship of women's documents as compared to the other four 
groups. While 64 percent of the first authors of the v/omen' s samples 
are female, 67 to 71 percent of the first authors in the other four 
samples are male. Finally, there are some substantial differences 
among the five groups in the singularity of focus of their document 
literature. For example, nearly two-thirds of the samples for mentally 
handicapped and women (65% and 61% respectively) focus exclusively on 
those groups, while only one-third (32%) of the physically handicapped 
sample deals exclusively with that group. 
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- ljlli<:i ^i^t>1ationsh1ps Among Other RK Content Analyst Varfnbl o s 

1. Overview . In the precGdJnfj section we foctjsed primarily on 
oxmiilntition of differences among the five equity groups In teniis of 
Lho various £in content analysis variables. We now turn to a briefer 
(^xoinination of the interrelationship among these variables. Table 25 
provides an overview In matrix form. The cells at the Intersection 
of each row and column indicate the results of chi square (or analysis 
of variance) tests for the designated variables. Empty cells signify 
iJint the chi square test for independence between the two variables 
is accepted. Asterisks signify that the test for independence is 
rejected ond at what significance probability (P) levels (* = P <.05; 



TARLE 25 

MATRIX OF TEST RESULTS FOR RELATIONSHIPS 
AMONG RJi CONTENT ANALYSIS VARIABLES 





GPS 


TOPIC 


PUB. 
DATE 


PUB. 
TYPE 


SPOH. 


PERF. 


COPY 
AVAIL 


ANON. 
AUTH. 


SEX 
AUTH 


NR 
GRS 


PAGES 


GROUPS 






*** 


*** 


*** 


*** 






*** 


*** 




TOPICS 








*** 




*** 






* 






PUBLICATION DATES 










*** 




*** 






* 




PUBUCATIOH TYPE 


*** 


*** 


*** 




*** 


*** 


*** 




* 




*** 


SPONSOR TYPE 


*** 




*** 


*** 




*** 


*** 


*** 








PERFORHEfl TYPE 


*** 


*** 


*** 


*** 






*** 


*** 








COPY AVAILABILITY 






*** 


*** 


*** 


*** 












A»ONYHOUS AUTHOR 










*** 


*** 


*** 








* 


SEX OF AUTHOfi 


*** 


* 




* 
















NUMBER OF GROUPS 


*** 




* 


















PAGE LENGTH 










*** 




*** 


* 









^^Where analysis of variance tests are involved, the test is for mean 
differences on the continuous variable over levels of the categorical 
variable. 
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The first row coluitin Identifies the significant differences among 
the five equity groups that have already been Identified. The remain- 
ing variables are discussed below. 

2. Topics . Aside from no differences among the four topics 
(attitudes, empl oyment, counseling, and curriculum) In publication 
dates and in copy availability, there are significant differences for 
all other variables. The five topics display vastly different pro- 
portions by publication type, as indicated in Table 26. Publication' 
types have been listed in this table by descending order for total 
percentages. 



TABLE 26 

PERCENTAGE OF Rll DOCUMENTS BY PUBLICATION TYPE 
EACH OF FOUR TOPICS 
150.35; P<.0001) 



FOR a 

(x5 = 





AHITUOES 


EMPLOYHEftT 


COUNSELING 


CURRICULUM 


TOTAL 




H*}2S 


H'}2S 




H*}2S 


N-500 


Research reports 


39 


40 


22 


12 


28 


Project descriptions 


6 


18 


26 


22 


18 


Speeches 


18 


10 


13 


9 




12 


Curriculum materials 


2 


2 


4 


30 


9 


Books 


17 


11 


6 


2 


9 


Guides 


6 


3 


12 


6 


7 


Proceed1n<is 


4 


6 


7 


4 


5 


Bibliographies, revlei^ 


2 


4 


6 


6 


5 


Theses 


S 


2 


2 


6 


4 


Journal articles 


1 


2 


1 


2 


2 


Ofrectorfes 


0 


1 


1 


0 


1 


Questionnaires 


0 


0 


0 


1 


0 


Total 


100 


59 


100 


100 


100 
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Although ro secird ) .reports represent a Httle more than a fourth (2iU) 
of the total sample, there is a wide difference between topics, with 
dUitudes (39%) and employment (40%) both containing significantly 
hinhtT, and curriculum (12%) significantly lower, percentages of 
rvsearch reports. 28 project descriptions is the next largest cateoory 
(10% ovorall), with significantly larger portions of the counselino 
<><mrpl(? (26%) and smaller portions of the attitude sample (6%) in the 
publication category. Speeches , mainly presentations at professional 
moetinys, represent one-eighth (12%) of the overall sample, but are a 
^Mjbstantial ly (and significantly) larger portion of the attitude sam- 
jiio (IfJX). While curriculum materials constitute nearly a third (30%) 
of tho documents on curriculum topics, they represent only two to four 
pnrcent of the samples for the other three topics. Books are a sub- 
stfintial part of the attitude sample (17%)» but a very small part of 
the curriculum sample (2%). Twice as many guides (12%) appear in the 
counseling sample as in any of the other three samples. Differences 
among the four topics are not significant for any of the remaining 
publication types. 

Topics also differ in sponsorship as indicated in Table 27. 



TABLE 27 

:RCrNTAGE OF RIF DOCUMENTS DY TYPE OF SPONSOR FOR EACH OF FOUR TOPICS 

(X2 = 42.13; P<.002) 





AHITUDES 


EHPLOVMENT 


COUNSELING 
N»125 


CORRICaLOH 
N^125 


TOTAL 
ff-500 


Federal 


34 


52 


47 


38 


43 


State/local ed. a9ency 


7 


5 


10 


19 


10 


Publishers 


11 


9 


7 


2 


7 


Foundations 


4 


2 


2 


2 


3 


Other state aqencfes 


4 


2 


— 1 

2 


} 


2 


Other sponsors 


2 


6 


3 


5 


4 


No sponsor Identified 


38 


24 


28 


33 


31 


Total 


100 


100 


99 


100 


100 



'^'^When significant differences are noted, they are based on inspection 
of the adjusted residuals for cells in the chi square tests of inde- 
pendence between the two categorical variables. They are thus tests 
of differences between the actual frequencies and the expected fre- 
quencies computed from the marginal (total) frequencies, rather than 
tests of percentages between two particular samples. 
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Federal agencies, hy far the largest type (43% overall), sponsor 
significantly more of the employment sample (52%), but significantly 
less of the attitude sample (34%). state and local education agencies , 
representing ten percent overall, are heavily represented In the cur- 
riculum sample (19%) but lightly represented In the employment sample 
(5%). Publ ishers represent seven percent overall, but they are a sig- 
nificantly minor sponsor for the curriculum sample (2%). Foundations , 
other state agencies , and other sponsors each contribute two to four 
percent of the overall sample and one to six percent for the samples 
for the four topics. There are no significant differences among the 
four topics for any of these sponsor categories (see footnote 28). 
Approximately a third (31% overall) of the documents could not be 
classified as to type of sponsor. The percentage (38%) of unclassi- 
floble documents is significantly higher for the attitude topic 
sample. 

Performer types also vary significantly across the four topical areas 
as Indicated In Table 28. 



TABLE 28 

PERCENTAGE OF RIE DOCUMENTS BY TYPE OF PERFORMER FOR EACH OF FOUR TOPICS 

(X2 = 77.51; P<.0001) 





ATTITUDES 


EMPLOYMENT 
N=125 


COUNSELING 
N-125 


CURRICULUM 
N«125 


TCTAL 
N-'SOO 


Universities 


57 


34 


38 


38 


41 


Local agencies 


6 


6 


22 


23 


14 


Non-profit/ 
for-profit agencies 


8 


18 


11 


IS 


14 


State agencies 


3 


8 


7 


12 


8 


Publishers 


11 


7 


7 


2 


7 


Associations 
and conmisslons 


6 


10 


8 


3 


7 


Federal agencies 


3 


14 


6 


2 


6 


Foundations 


1 


2 


1 


1 


1 


Not classifiable 


4 


2 


0 


2 


2 


Total 


99 


101 


100 


101 


100 
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A remarkably large portion (57%) of the attitude literature is pro- 
duced by authors affiliated with universities . There are marked 
contrasts in the contributions of local agency authors who contribute 
significantly more to the counseling and curriculum samples but sig- 
nificantly less to the attitude and employment samples. Non-profit/ 
for-profit authors contribute significantly less to the attitude 
samples. State agency authors provide significantly more than the 
expected amount of documents in the curricultin sample, but signifi- 
cantly less to the attitude sample. Exactly the reverse is true for 
publ ishers . Federal agency authors are especially high contributors 
to the employment literature. There are no significant departures 
from the average for any of the other performer types (associations 
and commissions, foundations, not classifiable). 

I*d()e length results were presented earlier (see Table 16 and accom- 
panying text). There are no significant variations by topic in cop y 
availability , but there are significant differences for authorship . 
Table 29 displays the percentages. Three significant discrepancies 
are found: 1) individual authors are predominant in the attitude 
samples (91% vs. 9% anonymous); 2) the male to female author ratio 
Is significantly higher than expected in the employment samples (54% 
male to 21% female); but 3) it is lover than expected in the curricu- 
lum sample (39% to 39%). 



TABLE 29 



PERCENTAGE OF RIE DOCUMENTS BY AUTHORSHIP FOR EACH OF FOUR TOPICS 
(Male-Female =111791; P<.02: Indiv.-Anon. Author = 13.74; P<.005) 





AHITUOES 
N-125 


EHPLOYHENT 
N=125 


COUNSELING 
N-125 


CURRICULUM 
N-125 


TOTAL 
N*500 


Hale First Author 


S8 


54 


46 


39 


49.4 


Female First Author 


33 


Zl 


29 


39 


30.4 














Hale and Female 
Ffrst Author 


91 


75 


75 


78 


79.8 


Anonymous Author 


9 


Z5 


25 


22 


20.2 














Total 


100 


100 


100 


100 


100 
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Finally, the four topics also differ In the number of equUy groups , 
ris shown "in Table 30. 



TABLE 30 

PERCENTAGE OF RIE DOCUMENTS BY NUMBER OF EQUITY GROUPS 
FOR EACH OF FOUR TOPICS 
(X2 => 17.02; P<.01) 





ATTITUDES 


EMPLOYMENT 


COUNSELING 


CURRICULUM 


TOTAL 




N*1Z5 


N-1Z5 


N-1Z5 


N-1Z5 


N'*500 


Only one group 


50 


A2 


50 


63 


51 


Two or three qroups 


38 


50 


38 


26 


38 


More than three grouos 


1Z 


8 


n 


11 


11 


Total 


100 


100 


99 


100 


100 



Significantly less of the employment samples focus exclusively on one 
group, while significantly more of the employment sample deals with 
two or three equity groups. The converse hold In the curriculum 
samples where significantly more of the documents are focused on 
one group while significantly less are focused on two or three groups. 

3. Publ ication dates . We have already noted that there are 
significant differences among the five equity groups in the average 
publication date of their RIE samples, but that there are no differ- 
ences for the four topics. Table 25 indicates that there are also no 
differences over publication periods in page length or in the propor- 
tion of anonymous authors. However, there are significant differences 
in the remaining variables, thus confirming the Paisley, et al. sugges- 
tion that time trends might be an important third dimension* In the 
following tables RIE. documents have been classified into three '*semi- 
decades" of publication (before 1970; 1970-1974; 1975-1979), and then 
cross tabulated with each qualtitative variable* Since the chi square 
tests for all tables are highly significant, commentary will again 
focus on cells that display significant discrepancies (adjusted resid- 
uals greater than 1.96; P<.05)* The significant differences found in 
Table 31 involve only three of the publication types: project descrip- 
tions, speeches, and books* Project descriptions consitute signifi- 
cantly less (8%) of the recent publications, but significantly more 
(26%) of the 1970-74 publications than the average (18%) over the 
three publication periods. While speeches (principally presentations 
at scientific meetings) constitute signTfTcantly less (6%) of the RIE 
literature in the early period, they constitute significantly more 
(19%) of the sample in the most recent period* Finally, bjOok;s are a 
significantly small (4K) part of the 1970-74 publications. We know. 
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TABLE 31 

PERCENTAGE OF m. DOCUMENTS BY PUBLICATION TYPES 
WITH THREE SEMI-DECADES FOR PUBLICATION DATE 
(X2 = 46.34; P » .0002) 





DP cnoc 


ly /U- 




I Ota 1 




1970 


1974 


1979 






N»]47 




N-t85 


M=500 


Rescdrch reports 


25% 


29% 


31% 


28% 


Project descriptions 


23 


26 


8 


18 


Speeches 


6 


11 


19 


12 


CurrTCulum materials 


7 


11 


9 


9 


Rooks 


12 


4 


11 


9 


Guides 


8 


5 


8 


7 


Proceedinns 


7 


5 


3 


5 


Bibliographies* reviews 


3 


4 


6 


5 


UUther_publ ication types 


7 


6 


5 


6 


1 Total 


98 


101 


100 


99 



that in the case of speeches, there has been a concerted effort to 
access presentations at the Annual Meetings of the American Educa- 
tional Research Association. Apparently, there have been fewer 
project reports in recent years. We suspect that the drop in book 
accessions in the 1970-74 period may reflect changes in ERIC RIE 
book accession policy. 

Sponsorship also displays some significant changes over publication 
periods that a^^e presented in Table 32. First, the proportion of 
documents with federal sponsorship is significantly higher in the 
last semi-decade, while the percentage of publ isher sponsored docu- 
ments has dropped after the first period {before 1970). Sponsorship 
by other (than educational) state agencies was higher in the 1970-74 
period, and other sponsor types have increased slightly after the 
earliest period. The major consistent changes over time have been 
away from accessing publishers' books, and toward accessing documents 
sponsored by federal agencies and "other** types of sponsors. 
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TABLE 32 



PERCENTAGE OF £XE SPONSORSHIP TYPES 
WITHIN THREE^SEHI-DECADES OF PUBLICATION DATE 
(X2 ^ 38.00; P => .0003) 





BEFORE 
1970 


1970- 
1974 


1975- 
1979 


Total 




N=147 


N=168 


N=185 


N=500 


Federal agencies 


39% 


40% 


49% 


43% 


State/local 
education agencies 


11 


10 


10 


10 


Publ ishers 


16 


4 


3 


7 


Foundations 


4 


1 


3 


3 


Other state agencies 


1 


4 


1 


2 


Other sponsor types 


1 


5 


5 


4 


No sponsor identified 


29 


36 


28 


31 


Total 


101 


100 


99 


100 



The time trends for performer types are displayed in Teble 33. The 
significant discrepancies in this table indicate that university 
performers contributed substantially less to the earliest semi- 
decade^ while publishers were (as both sponsors and performers) high 
contributors in this early period, as were commissions and councils . 
Non-profit/for-prof it agencies are significantly less well represented 
in the mid semi-decade (1970-74), while federal agencies show signifi- 
cantly higher percentages in the most recent semi-decade. 
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TABLE 33 



PERCENTAGE OF RIE PERFORMER TYPES 
WITHIN THREE SEMI-DECADES OF PUBLICATION DATE 
(X2 = 55.36; P = .0001)* 





BE PURE 

1970 


19/U- 
1974 


f y/b- 
1979 


Tota 1 


H=W 


N=168 




N^SOO 


Universities 


29% 


47% 


46% 


41% 


Local agencies 


18 


15 


10 


14 


Non-prof it/for- 
profit agencies 


14 


10 


17 


14 


State agencies 


9 


10 




8 


Publ ishers 


16 


4 


3 


7 


Federal agencies 


3 


5 


9 


6 


Commissions/councils 


7 


4 


2 


4 


Associations 


1 


3 


4 


3 


Foundations 


1 


1 


2 


1 


Not classifiable 


1 


2 


2 


2 


Total 


99 


101 


100 


100 



*Foundations and not classifiable rows were not included in chi 
square test clue to low cell frequencies* 



8. 
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Table 34 shows: (a) that both tnfcrofiche and hardcopy copy avaj la - 
bility have Improved significantly after the first setni-decade (par- 
tially due to decrease in the proportion of publishers' books); 
(b) there has been a significant decrease in the percentage of publi- 
cations focusef^ exclusively on one equity group In the most recent 
period as contrasted to the 1970-74 era; and (c) there has been a sub- 
stantial and continued shift In the percentage of male/female first 
authors , with female authors moving from 25% to 47% In the individually 
authored RIE_ documents over this period." 



TABLE 34 

PERCENTAGES FOR: (a) COPY AVAILABILITY (b) NUMBER OF EQUITY GROUPS 
IDENTIFIED AND (c) MALE/FEMALE AUTHORSHIP WITHIN THREE SEMI-DECADES 

OF PUBLICATION DATE 





BEFORE 
1970 


1970- 
1974 


1975- 
1979 


Total 


Copy Av4ll4b111ty 
Microfiche copy available 










74X 


95% 


90% 


87% 


Hard CODY available 


69% 


d&x 


74% 


77% 


b. Number of Eqitity Groups Identified 


52X 


59% 


44% 


5n 


Ortly one flcouD 


Two or three groups 


39 


33 


42 


38 


More thart three groups 


9 


8 


14 


11 


c. Male/Female Authorship 
















N'^399 


Male first author 


75X 


61% 


53% 


62t 


Female f*rst author 


25 


39 


47 


36 



"This trend is also evident when first and second authors are con- 
sidered. Papers authored solely by female authors represent 18, 26, 
^nd 36 percent of the Individually authored papers in the three peri- 
ods. Papers In which 3 female was listed as either first or second, 
represent 24, 33, and 44 percent of the individually authored papers 
in the three periods* For other data bearing on real or apparent in- 
creases over time in fenjale authorship of educational documents see 
Scheuneman (1979) and Lockv/ood and Stein (1980)* 



4. Publication type * Among all the variables considered In 
this iH£ document analysis, publication type Is undoubtedly the major 
v.irlabTe in terms of the number of significant relationships with 
nUier varlubles. We have already noted that publication typo varies 
ovor equity groups, topics, and publication periods. It is also sig- 
nificantly associated with type of sponsor, type of performer, page 
length, copy availability, authorship, and number of groups Identi- 
fied. Given these findings. It seems imperative that publication 
type be identified or controlled In subsequent studies of the RIE 
(Iota base. 



TABLE 35 

amS TABULATION OF ^ PUBLICATION CODE CLASSIFICATIONS 
WITII SPONSOR CLASSIFICATIONS 
(X2 - 225.42; P <.0000 





RESEARCH 
REPORTS 


PROJECT 
DESCRIP- 
TIONS 


SPEECHES S 
PROCEED- 
INGS 


CURRICU- 
LUM S 

GUIDES 


r 

8QQKS A 
HOMO- 
GRAPHS 


OTHER 
PUB. 
TYPES 


Total 


Mo Sponsor 
Identified 


A 
E 

AR 


36 

43.7 

-1.7 


24 

28.0 
-1.0 


45 

27.1 

+4.6*** 


17 

24.9 
-2.1** 


7 

74 .2 
-2.4** 


2S 

16.0 

42.8** 


154 


Federal 


A 

E 

AR 


77 

60.8 
+3.2** 


56 

38.9 

44.0*** 


21 

37.7 
-4.0*** 


33 

34.7 
-0.4 


12 

19.7 

-2.4** 


15 

22.3 
-2.1** 


214 


State/Local 

Education 

Agencies 


A 

t 

AR 


10 

14.5 
-1.5 


6 

9.3 
-1.3 


10 
9.0 
40.4 


18 
8.3 

43.9*^ 


0 

4.7 

-2.4** 


7 

5.3 
40.8 


51 

dot) 


Foundations, 
Other State £ 
Other Sponsors 


A 
E 

AR 


17 

12. B 

4l.5 


4 

8.2 
-1.7 


12 
7.9 

4l.7 


5 

7.3 
-KO 


3 

4.1 
-0.6 


4 

4.7 
-0.3 


45 

tn) 


Publishers 


A 

t 

AR 


2 

10.2 
-3.2** 


1 

6.6 
-2.5** 


0 

6.3 
*2.9** 


B 

5.8 

4l.O 


24 
3.3 
+12.4*** 


1 

3.7 
-1.6 


36 


Total 


142 


91 

tm) 


88 

(18X) 


81 

(16« 


46 


52 

(lot) 


500 



So 

72 



Table 35 displays the actual frequencies (A), expected frequencies 
{(■)» and adjusted residuals (AR) for the cross tabulation of publi* 
c<\tiof] type by sponsor type. Note that: some similar classifications 
have been combinod before cross tabulation to avoid very small expected 
cell frequencies. 

Proceeding rovr-wise, with brief commentary on cells displaying statis- 
tically significant adjusted residuals, we first note that, among the 
154 documents (31%) where no sponsorship is identified, there are four 
significant discrepancies between actual and expected frequencies; 
speeches A proceedings, and "other'* publication types (combines bibli^ 
ographies, theses, journal articles, directories; and questionnaires) 
both tend to have higher actual than expected numbers of documents with 
unidentified sponsorship, while the converse is true for curriculum 
materials & guides, and for books & monographs. Federal sponsorship 
is higher than expected for research reports and project descriptions, 
but less than expected for speeches & proceedings, books & monographs, 
and ''other" types of publications. State and local education agencies 
sponsor significantly higher than expected numbers of curriculum mate- 
rials & guides, but lower than expected numbers of books & monographs. 
Publ jshers produce two-thirds of all the books & monographs, but are 
rarely sponsors for other forms of publication. The residual class 
of foundations, other state & other types of sponsors displays no 
significant cell discrepancies, perhaps because it is a miscellaneous 
category. 

Table 36 displays the cross tabulation of publication type by perform 
mer type . In this cross tabulation, the same (combined) publ icatlon 
classifications were used as those in Table 35. with respect to 
performer types, associations and commissions were combined, but 6 
documents authored by foundations and 10 "not classifiable" documents 
were deleted before cross tabulation to avoid low cell frequencies. 
Hence, only 484 RIE documents are represented in this cross classifi^ 
cation. Again, proceeding row-wise, v/e first note that the major 
performer type, universities , displays a number of significant dis^ 
crepancies between actual and expected frequencies, with higher than . 
expected frequencies for speeches & proceedings and "other'' publican 
tion types, but lower than expected frequencies for curriculum mate- 
rials ft guides, and for books & monographs. Nornprof it/for- profit 
agencies tend to produce expected amounts of all types of publications. 
Associations ft commissions also tend to produce near expected numbers 
of documents for all publication types except project descriptions, 
where the actual number is significantly less than expected, local 
agencies , on the other hand, produce significantly more than the 
expected number of project descriptions, but significantly less than 
the expected number of books & monographs, research reports, and "other" 
types of publications. State agencies produce significantly fewer 
research reports, but more curriculum materials & guides. Considered 
as performers, publ ishers produce more books & monographs, but fewer 
than expected numbers of research reports, project descriptions, and 
speeches & proceedings (no surprises here). Finally^ federal agencies , 
as performers, produce significantly larger than expected numbers of 
research reports, but fewer than expected numbers of curriculum mate- 
rials ft guides. 



TABLE 36 



CROSS CLASSIFICATION OF PURLICATION CODE CLASSIFICATION 
BY PERFORMER TYPE CLASSIFICATION 
(X2 - 272.75; P<.0001) 





RESEARCH 
REPOfttS 


PROJECT 
OESCRIP- 
TIONS 

1 


SPEECHES 
PROCEEO- 
INGS 


CURRICU- 
LUM & 
GUIOES 


BOOKS & 
MONO- 
GRAPHS 


OTHER 
PU8. 
TYPES 


Total 


Universities 


A 

1; 

AR 


65 

59.4 

^1.1 


29 

37.6 
-Z-1** 


55 
37. Z 
+4.3*** 


Z1 

33.4 
-3.1** 


d 

id.o 

-3.Z** 


Z9 

Z1.4 
+Z.3** 


Z07 
(43X) 


Noil- profit/ 

For-profit 

Agencies 


A 
E 

AR 


Z5 

19.6 

^1.5 


9 

12. 5 
-1.Z 


d 

1Z.4 
-h5 


15 

11.1 
^1.4 


6 

6.0 
0.0 


6 

7.1 
-0.5 


69 

(14X) 


Assocutlorts 
It Conmisslons 


A 
E 

AR 


14 
9.6 
+1.7 


1 

6.Z 

-Z.4** 


6 

6. 1 
-0.1 


6 

5.5 
^0.3 


3 

3.0 
0.0 


4 

3.5 
^0.3 


34 
(7X) 


Loctil Agencies 


A 
E 

AA 


20.4 
-3.Z** 


J/ 

1Z.9 
+8.0*** 


g 

iz.d 

-1.6 


Id 

11.4 
+1.Z 


u 

6.Z 

-Z.8** 


7.3 
*Z.3** 


(is%) 


State A9enc1es 


A 
E 

AR 


5 

10.9 


9 

6.9 
^0.9 


5 

6.d 

*o.d 


1Z 
6.1 
+Z.7** 


1 

3.3 
-1.4 


6 

3.9 
^I.Z 


38 
(8%) 


Publ Ishers 


A 
E 

AA 


2 

9.d 
-3.1** 


1 

-Z.4** 


0 

6.1 

-Z.8** 


d 

5.5 
+1.Z 


22 
3.0 
+1Z.0*** 


1 

3.5 
*1.5 


34 
(7X) 


Federal Agencies 


A 
E 

AR 


19 
d.9 
+4.t*** 


2 

5.6 
*1.8 


5 

5.6 
-0.3 


1 

5.0 
*Z.O** 


2 

2.1 
*0.5 


2 

Z.2 


31 

(6%) 


Total 


139 


A2 
(9X) 


86 

(id%) 


78 

(16X) 


87 

(18X) 


50 

(lOX) 


484 



86 

74 



F'ubUcation type Is significantly related to microfiche (MF) and hdrd 
copy (HC) availability (as indicated in the column labelled "% MK 
Avail," and "% HC Avail," in Table 37), (Please note that percentage 
availability shown In the total row are based on all 500 documents.) 
The availability of books and monographs (26% in MF; 15% in HC) and 
guides {59% in MF; 50% in HC) are both significantly below the overall 
averages (87% for MF; and 77% for HC). Note that 94 to 100 percent of 
the documents are available in microfiche for seven of the publication 
types. 



TABLE 37 

COPY AVAILABILITY BY TYPE OF PUBLICATION 



Publ i cat ion Type 


% MF 
Avail. 


% HC 
Avail . 


Books & monographs 


26% 


15% 


Theses 


100 


100 


Proceedings 


96 


96 


Curriculum materials 


94 


83 


Guides 


59 


50 


Project descriptions 


95 


86 


Research reports 


95 


85 


Bibliographies, reviews 


100 


83 


Journals* serials 


86 


57 


Speeches 


98 


92 


Total 


87 


77 
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75 



86 



TABLE 38 



PERCENTAGfiS WITHIN PUBLICATION CODE CLASSIFICATION FOR 
(.j) TYPES OF AUTIIORSMIP AND (b) NUMBERS OF EQUITY GROUPS IDENTIFim 
(Indiv.-Anon. Author X2 » 66.48; P<.000l! Male-Female X2 » 19.00; P<.02: 
Number of Equity Groups X » 24.43; P<.005) 





Authorship 


Number of Equity 
GrouDS Identified 


Nuniber of 
Docu^nonts 




N-101 

Anon. 


Male 


N"1S2 
Female 


One 


N*244 
>1 


N- 


R(>sparch reports 


T8 


53 


29 


49 


51 


142 


Books & mono^r<iphs 


4 


63 


33 


37 


63 


46 


Project descrlpttons 


32 


47 


21 


51 


49 


91 


Guides 


15 


59 


26 


62 


38 


34 


Speeches 


0 


65 


35 


55 


4S 


62 


Curriculum materials 


ZB 


23 


49 


74 


26 


47 


Bibi ioqraphles* reviews 


39 


26 


35 


26 


74 


23 


Proceedlnns 


5B 


19 


23 


38 


62 


26 


Theses 


0 


63 


37 


63 


37 


19 


Journal articles, serials 


14 


57 


29 


57 


43 


7 


Directories 


100 


0 


0 


50 


50 


2 


Questionnaires 


0 


100 


0 


0 


100 


1 


Total 


20.2 


49.4 


30.4 


_51,2 


48.8 


soo 



Table 38 presents percentages within each publication type for author- 
ship, and for number of equity groups identified. Focusing first on 
the comparison of anonymous authors to identified authors (male and 
female combined), we note that there are significantly larger than 
expected percentages of anonymous authorship for: project descrip- 
tions, bibliographical reviews, and proceedings; while there are sig* 
nificantly lower than expected percentages for: books & monographs, 
speeches, and theses. (Data for journals* directories, and question- 
naires are included In Table 38» but were not included in chi square 
tests because of low frequencies)* When we compare only the male to 
female (ffrst author) percentages, we note that* overall , males are 
first authors of about 60 percent (61.9%) and females 40 percent (38.1%) 
of the 399 documents where an individual author Is identified, while 
in three cases^ female percentages exceed male percentages. Curricu- 
lum materials is the only publication type displaying a statistically 
significant discrepancy from this overall proportion* In this instance, 
only 32 percent of individually authored curriculum material have male 
first authors. 



Turning now to the number of equity groups identified in RIE docu* 
ments, our comparison is made between the percentage of documents 
within each publication type that dealt exclusively with one equity 
group, or dealt with more than ono group. Overall, roughly half of 
the documents (51.2%) focus primarily on one equity group, while the 
renidinder deal with more than one equity group. There are 

three statistically significant departures from these overall pro- 
portions; books & monographs and bibliographies & reviews have much 
higher percentages of documents dealing with more than one group, 
while curriculum materials have a significantly lower percentage of 
multiple group treatments. CCh1 square Is based on first ten publi- 
cation types. ) 

5. Sponsor type . We have previously noted that sponsor type is 
significantly associated with type of equity group, topic, publica- 
tion date, and publication type. In this subsection, we shall look 
at three of the remaining significant relationships with: performer 
type, copy availability, and anonymous authorship. Note that the 
only variables which are independent of sponsor type (no differences 
across sponsor types) are sex of author and number of equity groups 
identified. Page length for sponsor type will be examined in a later 
section. 

Table 39 displays the cross tabulation of sponsor and performer types. 
Note that several classifications for both variables have been omitted 
in order to provide a better test for independence. First, all 34 
publisher "performer" counts are associated with the publisher "spon- 
sor" classification (^=36). Second, all 31 federal "performer" counts 
are associated with the federal "sponsor" classification (^-214). 
Third, five of the six foundation "performer" counts are associated 
with the foundation "sponsor" classification (N=14). Eight of the 
ten *'not classifiable by performer" counts are associated with the 
"not classifiable by sponsor" classification {N=154). Each of these 
performer classifications were omitted because they were obviously 
associated primarily with one sponsor type. The publisher sponsor 
classification was then omitted because it contributed only two 
counts to the remaining table. Finally, the state (non-educational) 
agency sponsor classification was omitted because the 11 state agency 
sponsored documents were produced either by the state agency itself 
{N=^3) or by universities {N=8). The consequence of these omissions 
1s a more conservative test of association between sponsor and per- 
former types. Also, as noted in Table 37, the association and 
council/commission performer classifications, and the foundations 
and "other" sponsor classifications were combined to avoid small 
expected cell frequencies. 

Despite these omissions, 408 documents (82% of the sample) are repre- 
sented in this cross tabulation, which displays a highly significant 
rejection of the chi square test for independence. The significant 
adjusted residuals (AR) flag the cells where there are significant 
discrepancies between actual (A) and expected (E) frequencies. 

Inspected row-wise, we can ask where different performers secure their 
sponsorship. We see that about half of the 199 documents produced by 
university based authors provide no sponsorship identification. This 



ERLC 



77 8e 



is significantly more than expected. Conversely, significantly fewer 
than the expected number of university produced documents are sponsored 
by stdte and local educational agencies. The universities' shares of 
federal and of foundation S "other" sponsor types are close to the 
expected values. 

Exactly two-thirds of all non-profit/for- profit agency produced docu- 
ments are federally sponsored. This number 146J is significantly 
larger than the expected number (30.8). This performer type also 
produces more than the expected number of foundation S "other" spon- 
sored documents, but conversely fewer than the expected number of 
state/local educational agency sponsored and "no sponsor" documents. 



TARLE 39 

CROSS TABULATION OF RIE SPONSOR AND PERFORMER CLASSIFICATIONS 

(X^ 148.11; P <.0001) 



■ 

PERFORMER 
nPE 


SPONSOR nPES 


NO 

SPONSOR 


FEDERAL 
AGENCIES 


STATE /LOCAL 
EDUCATIONAL 
AGENCIES 


FOUNDATIONS 
ft OTHERS 


TOTAL 


UNIVEHSITIES 


A 

E 

AR 


101 
71.2 
+6.2*** 


79 

88.8 
-1.9 


8 

24.4 
-4.9*** 


11 

14.6 
-1.4 


199 
(495t) 


NON-PROFIT/ 

FOR-PROFIT 

AGCNCUS 


A 

E 

AR 


n 

24.7 
-3.8*** 


46 

30.6 

+4.0*** 


3 

8.5 
-2.1** 


9 

5.1 
+2.0** 


69 

(17X) 


ASSOCIATIONS/ 
COMMISSIONS 
S COUNCILS 


A 
E 

AR 


10 

12.2 
-0.8 


14 

15.2 
-0.4 


2 

4.2 
-1.2 


8 

2.5 
+3.8*** 


34 
(8X) 


LOCAL AGENCIES 


A 
E 

AR 


23 

25.4 
^0.7 


31 

31.7 

-0.;? 


16 
8.7 
+2.9** 


1 

5.2 
-2.1** 


71 

(T75t) 


STATE AGENC'E> 


A 

E 

AR 


! 

12.5 
-4.3*** 


12 

15.6 
-1.3 


21 

4.3 
+9.0*** 


1 

2.6 
-1.1 


35 
(95t) 


TOTAL 


146 
(36t) 


162 
(45t) 


50 

(12t) 


30 
(75t) 


406 



8u 

78 



Asspciotlons/comrnlsslons & coirnclls produce a larger than expected 
number of documents sponsored by foundations & "other" sponsors, but 
near tho expected numbers for the remaining sponsor classifications. 

Local afioncies produce more than the expected number of documents 
that ore sponsored by state agencies or by their own local agencies, 
while they rarely perform work sponsored by foundations or "other** 
sponsors. Their "no sponsor" and federal sponsor frequencies are 
cjinte near the expected frequencies. 

Ftnnlly, state agencies are distinguished in two ways: most of their 
work is sponsored by their own agency and they rarely fail to identify 
the sponsor of their work. 

Page length data for sponsor types will be presented in a later section. 

Table 40 displays data for the remaining two significant content vari- 
fibles: copy availability and anonymous authorship. The first thing 
th<it v/e note in Table 40 is that publishers rarely make their docu- 
ments available, and they never publish anonymously. A^'ter removing 
this highly discrepant sponsor cl asssification, and combining the last 
three sponsor classes listed in the table (they are similar in copy 
availability and anonymous author percentages), a chi square test 
indicates that foundations are discrepant, with significantly lower 
than expected copy availability, while the "no sponsor*' category 
displays significantly Ipwer than the expected number of documents 
with anonymous authorship. 



TABLE 40 



PERCENTAGE OF MICROFICHE (MF) AND HARD COPY (HC) AVAILABLE, AND 
PERCENTAGE OF ANONYMOUS AUTHORSHIP FOR RIE DOCUMENTS BY 
SPONSOR CLASSIFICATIONS 



SPONSOR TYPE 


N. of 
Doc. 


% MF 
Avail . 


% HC 
Avail . 


% Anon. 
Author. 


Publ ishers 


36 


8% 


8% 


0% 


No Sponsor 


154 


90 


81 


10 


Federal Agencies 


214 


95 


83 


28 


Foundations 


14 


64 


57 


29 


Lr.omblnedJ 


L32J 


im 


L89J 


L27J 


• State/local ed. agencies 


51 


96 


88 


29 


• Other state agencies 


n 


100 


100 


18 


• "Other" sponsors 


2d 


100 


85 


25 


Total 


500 


87 


77 


20 
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6. Perfonrier typos . Performer types exactly mirror sponsor types 
in their significant associations. Most of these have been presented. 
Page averages for performer types will be examined In a later section, 
lioro we examine the two remaining significant relationships: copy 
dVflllabillty and anonymous authorship. Table 41 presents these data. 
The publisher data are nearly the same as those presented in Table 40 
sinCf? almost the same set of R IE documents were classified as '*pub- 
liijher" for both sponsor and perfonner. In this classification, when 
publishers and the two very low frequency types at the bottom of 
Tdhle 41 are omitted (foundations and not classif ied--they were not 
caiibfned because of the substantial differences In MF and HC percen- 
tages), chi square tests are insignificant for both MF and HC availa- 
bility. In other words, there are no significant differences in copy 
avdilabillty for different performer types when the highly discrepant 
effect of publishers and foundations are removed. 



TABLE 41 

PERCEirrAGE OF MICROFICHE (MF) AND HARD COPY (HC) AVAILABLE, 
AND PERCENTAGE OF ANONYMOUS AUTHORSHIP FOR RIE DOCUMENTS 
BY PERFORMER CLASSIFICATIONS 



PERFORMER AGENCY TYPE 


N. of 
Doc. 


% MF 
Avail. 


% HC 
Avail. 


% Anon. 
Author. 


Pub] ishers 


34 


n 


9% 


0% 


Universities 


207 


94 


85 


9 


Non-prof it/for- profit 


69 


88 


77 


26 


Associations & councils, comm. 


34 


33 


74 


50 


Local agenciies 


71 


96 


S9 


27 


State agencies 


38 


95 


92 


42 


Federal agencies 


31 ^ 


100 


77 


32 


Foundations 


6 


50 


33 


17 


Not classified 


10 


SO 


60 


10 


Total 


500 


87 


77 


20 



Inspection of the percentages for anonymous authorship again shows 
publishers as highly discrepant, but there are several other inajor 
departures from the overall percentage (20%). A chi square test over 
the first seven perfonner classifications indicates that publishers 
and university performers produced significantly fewer RIE doc .inents 
with anonymous authorship, while associations & councils, pcmmissions 
(primarily due to the councils and commissions), and the state agen- 
cies produced significantly more than the expected number of anony- 
mously authored documents. 

7. Copy availability . We have previously noted that copy avail- 
abllity Is significantly associated with publication data, type of 
publication, sponsorship, and type of performing agency. Page length 
will be discussed in the next section. The remaining significant 



association is with anonymous authorship. Stated briefly, 98 percent 
of all anonymously authored documents ore available in microfiche fonrit 
while 84 percent of the identified author documents are available in 
microform. This difference is due largely to the fact that agencies 
tend to produce anonymously authored documents (e.g.» state agencies 
and coniTiissions) and almost always provide microfiche copy releases. 
Hard copy release is another matter. Here only 85 percent is avail- 
able for anonymous documents compared to 78 percent for identified 
author documents. This is not a significant difference. 

8. Authorship . Aside from the association with page length to 
be discussed next, all significant relationships Involving this vari- 
able have been presented. 

9. Page length . In this section, we shall consider the matter 
of page length for different content classes. Table 25 (p. 62) indi- 
cates that average page lengths differ significantly when (one-way 
analysis of variance) tests are run over classes for nearly all of 
the variables. 

It should come as no surprise that there are major differences in the 
average page length of the various types of publications. Table 42 
displays the average page length ordered from highest to lowest; 
along with the number of documents on which the average is based. 
Since there were only two directories and one questionnaire, averages 
are not reported for these publication types. In sixteen other cases, 
principally books, no page lengths were reported. Books and mono- 
graphs average more than two hundred pages, while speeches average 
about twenty-two pages. The other publication types are arrayed 
between these two extremes. The books and monographs page average 
(207.8 pp.) is significantly l^rc)er than the average for proceedings 
(149.2 pp.), which, in turn, is significantly larger than research 
reports (92.3 pp.), which, in turn, is significantly larger than 
speeches (21.8 pp.)* 

TABLE 42 



AVERAGE PAGE LENGTH BY TYPE OF PUBLICATION 



Publ ication Type 


N 


Average 
Pages 


Books & monographs 


38 


207.8 


Theses 


19 


175.5 


Proceedings 


26 


149.2 


Curriculum materials 


47 


121.9 


Guides 


31 


118.5 


Project descriptions 


% 


116.6 


Research reports 


140 


92.5 


Bibl iotjraphies, reviews 


23 


86.3 


Journals, serials 


6 


28.2 


Speeches 


61 


21.S 


Total 


481 


106.9 



O 81 

ERIC 



Recause publication type differences may be the chief reasons for 
m^any of the one-way analysis of variance differences* two-way* 
unweighted means, analysis of variance tests were run to see if the 
differences would exist when variance due to publication type is 
removed. Table 43 summarizes the results of the one-way and two-way 
analysis of variance tests. 

For equity groups* there are no significant differences in page length 
for either type of test. For topics, the significant main effect 
found In the one-way test is still signficant, albeit at a lower 
level, when the effect of publication type is considered. For publi- 
cation periods, there is a significant main effect in the one-way 
analysis; however, in the two-way analysis, there Is a significant 
Interaction effect between publication period and publication type. 
The highly significant main effects for sponsor type and for performer 
type, found in the one-way analyses, disappear when publication type 
is considered. These particular results mean that the average of 
page length for each type of publication do not differ significantly 
over sponsor types or over performer types. The reasons for the 
significant main effects found in the one-way analyses are thus due 
primarily to differences In the proportions of types of publication 
among sponsor types (see Table 32) and among performer types (see 
Table 33). The highly significant main effect for hard copy availa- 
bility, found in the one-vtay analysis, persists in the two-way analy- 
sis, which shows that average page length is consistently greater 
In all six publication types where there are many unavailable hard 
copy documents. The significant author effect found In the one-way 



TABLE 43 

SUMMARY OF ONE-WAY AND TWO-WAY ANALYSIS OF VARIANCE TESTS 

FOR PAGE LENGTH 



CONTENT ANALYSIS 
CATEGORY 


ONE-WAY 


TWO-WAY (UNWEIGHTED MEANS) 


MAIN 


INTERACTION 


EQUITY GROUPS 


NS 


NS 


NS 


TOPICS 


** 


* 


NS 


PUB. PERIOD 


* 




*** 


SPONSOR 


*** 


NS 


NS 


PERFORMER 


*** 


NS 


NS 


MF AVAILABLE 


*** 


*** 


NS 


AUTHOR 


* 




* 


NR. GPS. ID. 


NS 


NS 


NS 



82 



93 



ijnt)1ys1s, appears 1n the two-way analysis as an Interaction effect* 
Finally, the absence of a main effect for members of eqtjity groups 
1s aynin noted In the two-way analysis* 

The page length data for variables displaying the significant effects 
jii*it reviewed will now be examined* 

Topics * The weighted (by proportion of documents for each pub- 
lication type) 1 unweighted and reweighted paper length means for the 
four topics are displayed in Table 44. Note that the unweighted means 
dato are the results that would be obtained if all nine publication 
types were equally represented in each and every topic sample. 

A more realistic comparison Is provided by the reweighted means, which 
are the results that v;ould be obtained if the proportion of each pub- 
lication type corresponded to the percentages by publication type 
reported for the total sample of 500 documents in Table 19 {p. 55). 
The weighted means are, of course, the actual page averages for each 
topic for all RIE documents classified by any of the nine publication 
types listed in the table. ^0 

The F-tests of differences among means in all three sets are signifi- 
cant. Focusing on the more realistic data for weighted means and 
rev/eighted means, we note that the page averages for the attitude 
sample are significantly smaller than those for the employment sample 
(P<.01), but there are no other significant differences. The topic 
difference is thus primarily attributable to the difference between 
the much shorter length of RIE documents dealing with attitude topics 
and the much longer page length of RIE documents dealing with employ- 
ment topics. 

Publication period . The weighted page length means for the 
three semi-decades are 125.0, 89.2, and 113.0 pages. The correspond- 
ing reweighted means are 119.8, 90.0, and 120.5. F-tests for both 
sets of means are significant at the P<.05 level. However, the two- 
v/ay analysis of variance indicates a highly significant (P=.0002) 
interaction between semi-decade of publication and publication type. 
Inspection of means for individual types of publications indicates 
that three types, curriculum materials, proceedings, and reports 
diiiplay significant differences in which the page length of publica- 
tions of that type are much greater in the most recent semi^decade 
as compared to the 1970-74 period. 



^^Three other types of publications, journal articles, directories, 
and questionnaires, are not included because their numbers are too 
few to provide page estimates for all four topics. Together they 
represent only 2 percent of the 500 documents in the total sample. 
Wote that theses have been included in Table 44. Theses, included 
in "other types" in Table 19, represents 3.8 percent of the sample 
500 documents. The reweighted means are thus based only on the nine 
publication classifications listed in Table 44. The weights are 
based on the percentages reported in Table 19 and the 3.8 percent 
for theses. 
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TABLE 44 



WElGHTEn, REWEIGHTED, AND UNWCIfJIITED MEANS FOR PAGE LENGTH 

FOR FOUR TOPICS 





ATTITUDES 


EMPLOYMENT 


COUNSELING 


CURRICULUM 


TOTAL^ 


H^an 


U 


Mean 


N 


Me An 


N 


Mean 


U 


Mean 


a 


UTlGMTrn HTAMS 


83.0 


119 


133.5 


119 


104.6 


119 


110.4 


118 


107.9 


47$ 


RfWflGHTfO MEANS 


88. Z 




130.6 




11Z.4 




107.3 




109.6 




UNWEfGHTEO MEANS 


95.0 




152. Z 




116. Z 




1Z0.9 




TZ1.1 




MEANS BY PU&LICATION CODE 
*1. BOOKS 


163.5 


17 


216. 3 


13 


Z86.8 


5 


Z89.7 


3 


Z39.1 




Z. CURRIC. MATERIALS 


4Z.5 


2 


1Z5.3 


3 


1Z1.0 


5 


1Z6.1 


37 


. 103.7 




3. GUIDES 


119.0 


6 


b:;>5 


4 


136.9 


15 


6Z.0 


6 


nz.9 




4. PROJECTS 


138.8 


8 


109.8 


Z3 


117.3 


33 


114.8 


Z6 


IZO.Z 




5. BIBLIOGPAPHIES 


31.0 


3 


1Z0.Z 


5 


93.9 


7 


79. Z 


8 


81.1 




6. PROCEEDINGS 


1Z3.Z 


5 


Z64.T 


7 


84.1 


9 


131. Z 


5 


150.7 




7. REPORTS 


61.9 


49 


1Z6.Z 


49 


96.4 


27 


73.1 


IS 


89.4 




8. SPEECHES 


Z3.3 


Z3 


ZO.D 


1Z 


17.9 


16 


Z6.7 


10 


ZZ.O 




9. THESES 


151.7 


6 


Z54.0 


3 


91.0 


2 


185.0 


8 


170.4 





*The r«wel9hted and unweighted means rows and means for each pub* 
Ifcatlon code type In the total column are unweighted means (l*^** 
simple averages of the other means In each row). 



9o 



84 



















w 


rT 








w 








Of 








c 




o 


(/I 


rT 


fP 


fp 










'O 




T 


T 


T 








O 








Of 


Of 




o 


'3 










n- 




T 




O 


n- 












o 


n 






Of 


o 




— 1 


T 






































o 












CD 




T 


n 










CL 


CO 














• 
































Of 
































fD 


fD 






























n 






































































ro 














ro 






ro 






_t 




o 




ro 


vo 


















^ ST 














to 


fD O 


L 




Co 










0^ ^■ 












* 






PO 


PO 










ro 


































fD 
















Cl 




















o 


3 












00 


to 


CO 


CO 






vo 




o 


00 










cn 
















to 
















3", 
















r-h 
















fP 
















CL 



> 



> 



> 

CD 



fP nr-r^^*C Of Ofl» Ofl»^"a 

O -*'fD03-*-"lfD^ rOCfDW^fD fl*— *OCfD-^ 
r+"33 ri-OO r O Td^ — »_hr+fD fD"3 

03"-j. 3O— *fl*-oa s trt Dj 3" ri3"t/) = TOiu 



O3 '^fD fD W '^fD rr— *fD 
OfQ-C ri- trt 13 ^. c a> Q* 



(/I fif ~0 
-O 3 -^. O 13 r-r — » X 



c+fDfD OOffd TfD3"WfD** OfD — •3"0«j* — »3 0*3 -^r+^ 
^^T3^TfD NO*-^*fDCT<fD ^C^CT — --.^ 

fD WW'fD fD-^3 sfDfD^nt/l — »^**c-1^ ^30Q 
O =-**00 *3(/iarfDnQ. ^<-** 

<CTT — i-O— 3" •fp_i. -I* WSCfP— -Q3*0 

fD — »0'03"— *cn"tO =r+* 3 13 O a> Crl^OtO 
T^.-OCfDCO C03~ '0<3T*^- 3afD3"3W 



3" C 
fP CT 



< < 

fP a* 

rp 



CO 

O 



n O O"^ "Oc-I^O fD^CT-i^fDWOW 

tOO*T — » tOfDCQ-3"r+C^ — ^3fl* O 
fDr+r+-J-0*fDQ>0"fDfD3"0" <^-**"l tO^OWT 

-J. trt T Q. * — 'WTfD — • trt D_ fD r+ Q O* — • 

0003-fp* ~ -*--O3fPfl)C3"0CT33r1-QjE-i- 

-^33fD = 0(/lO^ 3fDfD<^"0"0^0"fDn 

trt Q, Q. r-h Cl*OiOiW<3-3 -^r+-»- fD C — '"O — • -»* O* 
Of 3"r+3r+Wr+fDfDWr+T w T c+r+fD fDfD^O 

— OfPn-fP3"Q_-** fl*TT03"Q'^3"c: 3"fP W 3"-*, 
— »^ 3" fD O =c-1^fl*WTfD3-**c-1^ar+fDQ>0* -F*c-1^0 
r-h < c-I^S'OfD— * > iA fD-»* 3" Cn fD 13 

"O r-h O ri- a> 3 3" — » — »'0 'OfDr+Q>30fD'OO", Q>W 
C3" — 'fDTC+CO* TCW3" T^I^>Q- 
O'Ofr+rl'COffD^tOtOaOO"* fDO* I'-^tO fl> £ 

— »r+3"^fD3fD'OtOfDfDQ- — • WOr+fD'OE |m Of (/i 3 O 

O'OWta fDfD^fl^C-'- T 03~_hOfD -i*-0 Q> C 

nr+wfD o Q>n3nnt/>fDr+afDtOT-»*Q-3 — • — » 

Of^fD d^^^a fDOffDEO'O 3"r+tOO* 0*"1Q> 

n^-o 03"0 fP fP-^Q-n^nfP c:-on--»*3"n -"-c 

-i-fD-^'^fl^Tr+Of-i^wO 0-**wr+TfD0r+Cc-l^W5O"r*nta 
O O 3"33 l3O3^'O0fOQ.3-'-33~ (5fD3~fl> — ' 

n^fPwn^-o 03CL3"0n--o 3fPfPn--»- fP3^ 

ta3"3CE3" OtO" *r+3-i*030t03 3"tOfD r+* 

-**Q_0"OfDfD-h 0-*-0"c-1^ -fcWOTfD'^ rt^fD 3-_C) T 
on — » c trt -Hi* o ri- Q. CX -** 3 O 13 r+ & " — <- W fD r+ C O/ Q- rl" 

-^3"-*. -** — »fDtO"l3"C — •CT'Or+tOT -•■3*^3* -•*EfDO*n--**3" 
300. 3" fDO-i. — »fD (/lOO(/l3~C OfDQ. — •3"-hO 

r+a fl* Wr+-OWfDO-*. 0"n3"n3 fD — • 3"-*. — 'fD-h 
3" < r+ 0"'0 C fD Q.^ OnfDO-*-nw-^ r+— I r+tO 3 ^ T fD r+ 

0-0-i*3"fP3"fP 

3 9 

TOE 
Q fP 0> 



3" n 

^ § 3 

— » trt o 

rp 

O Q- 

Of ^ O 

^ 3 < 
O 



CO 


Of fD 


3" 


fP 0 


3 


CT 






T ^ 


fP n 


3 


-0 c 




n- T 


rp 




rp 




n 






— » Of 


- -1 


0 


Of 




13 trt 


a» 


^* 


rp 




^ Of 


— 3 




• 






n- 


« 0 0 










3"-0 


\A fD 


n- 






^ fP 


0 






3" 




CL 


3" 




Of 


0 


0 


-0 Q_ n- 






rp 




rp 


fP 










rp 




CT CL 








in fD 
















trt 






• W 


n- n 


0" 


fP T 


— 1 


3" 






T 










3" fP 






-< 


3 fP 


\A 


-0 -h fP 




Of 












fP n- 






a» 


c: (/I 






n 


0 




T3 trt 






m 




3 






CL 






rp 0 






n 


CO 




"O 


^ Qi & 


n- 






n- 








— ^ 










3" 






3" 


r+ n- 


5^ 




C fD 




rp 


rp 


(/I fD 


rp 


0 


CO 


rp 


3" 3" 






CL 








3- rl- 


T 


T 






fP 


ri r+ n 


fD 3 




Of ^ 




fD 3"_Q 








3 




cu 0 


rp 


CL 0 




3 Of 




Q. Of C 




n 


rp 




n- 




n- 












0 


rp 


Of 


n 




n- 


n- fP 




— fP 




n- 




c 






rp 


0* 


3" 


3" 




rp 




rp 


Of 


7 










rp 


fP n- 




• 






te 










re 


ha 



"iC-OfPQ-n-fl*"! 
O" — * fD 3 fD 



3 fl* fD fD "1 

nn^^CfOffl^fD 



3" r+^^-i-trt Q. a» fD 
r+ ^* to — » 3 

w^ofp 3"fl*"i^ n- 

'03fl*r+TfD WfD 
-»-fP nfPfPE-»-Q_ 
3 3" Q. fD w 

W O ^ r+ — 

n- "h'd trt 3 3"tO -O 3 

fD TD fD fD 3- T 
3 trt O Qj r+ fD (/I 



W r+ T fl* c 
O 3"^ "1 Of 
T fD fD ^ 



3 "O <^ ^ 



w ^ 3 

-»-3 o 

no-** 

Of (/I 3~ 

t/l O fD 

C 3 CL 

3 \A 

-O O 3 
rp 

O 3 

3 trt 



o T ri --t 
ii, O 3- 

3^00 

O Q- _ 
3 O 
fD * (/I 3 

n 

fP 3" CO Cf 

o o 

at 

^ ^ \A \A 
3- 3 * 

— » Cf O — • 
^OO — 

0 -o £ 

1 — > • 

fD 
-^3 
O Cf 

-o n- -3 n 

fP 3" 12. C 
T T 
T T 
000-** 
Q- T -Q n 

* O C 

— zrn- t 
ro o trt ^ 

< T — • Cf 

I/* *p o n- 
— -1 

o < 

O ^ (/I Cf 
O * — ' 

• O O 

O "3 O 

Cf trt 

\A 3 

O ^ 

\A 3- 
_h fD 

30* 



If all this were so, then we note that the page average for publishers 
drops substantially. Tests of differences among means show that the 
weighted page mean for publishers is significantly greater than the 
page mean for all other sponsor types , but that there are no other 
^significant differences among the weighted means. When the reweighted 
\ma\\s are tested, only the extreme difference between publishers and 
no sponsor is found to be significant. 

Perfonner types . Table 46 presents the \veighted and reweighted 
means for perfonner types. Almost exactly the same comments made 
regarding sponsor types can apply here. Theses were deleted because 
universities are almost the exclusive performers for this publication 
type. Twelve of the 72 performer type/publication type cell means 
were missing and "plugged" with the page mean for the publication type. 
And again, the significant differences involve the publisher {as 
performer) category. However, in this instance, both the weighted and 
reweighted page means for publishers are significantly different from 
the respective page means for all other types of performers. And 
again, as in the case for sponsors, there are no other significant 
differences among the means for other performer types. 



TABLE 46 

WEIGHTED AND REWEIGHTED PAGE MEANS FOR PERFORMER TYPE* 



Sponsor Type 


N 


Weighted 
Mean 


Reweighted 
Mean 


Publ ishers 


26 


249.4 


211.3 


Associations 


11 


153.7 


SO.O 


Non-prof1t/for-prof1t agencies 


67 


131.2 


124.3 


Councils/commissions 


19 


ll6.1 


102.0 


State agencies 


37 


105.4 


^9.5 


Federal agencies 


30 


91.4 


90.2 


local agencies 


70 


91.0 


89.9 


Universities 


182 


76.1 


?8.7 


Not identified 




75.0 


6^1.5 



^Two-way ANOVA within cells Mean Square = 9940. 



^Ifiecause these are aposteriori tests of mean, the Newman-Keuls pro- 
cedure was employed with the harmonic mean of the sample sizes {in 
this case, the number of documents of each sponsor type) used to 
compute the q statistics, and with the mean square error taken from 
the within cells mean square from the two-way analysis of variance. 
Since the harmonic mean is employed, this is an approximate test. 
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Rocduse publishers appear both as sponsors and perfonners, they con- 
stitute an anomally in both classifications. When we examine the 
publisher publication type data closely, we find that books and oxides 
<)r() most numerous, but one or two publisher produced research reports 
and project descriptions are Included in the sample. All four tjfpes 
of publications are, in fact, substantially longer than publications 
of the same type produced by other performers or sponsored by other 
sponsors. For this reason, even when the means are reweighted, the 
publisher means are still the largest on the list. However, perhaps 
the more remarkable points are: 1) when the publisher category is 
omitted, there are no other significant differences among the means; 
and 2) when the means are reweighted, the ranges of these non- 
significant differences are substantially reduced for both the 
sponsor and the performer types. 

Copy availabil ity . In this analysis, we focus on hard copy avail- 
ability ~sTnce~TTdrger proportion of hard copy documents are not avail- 
able. We discovered that some publication types were always avail- 
able (i.e., bibliographies, theses, speeches). Table 47 presents 
the data for the six publication types where hard copy is not always 
available. Note that the page mean is larger for all six publication 
types for documents not available in hard copy form. The weighted and 
reweighted means, summed over the six publication types, are more than 
twice the page length for the "hard copy not available*' samples as 
compared to the samples where hard copy is available. 



TABLE 47 

SAMPLE SIZES AND PAGE MEANS FOR RIE DOCUMENTS 
THAT ARE OR ARE NOT AVAILABLE IN HARD COPY 





HC Available 


HC Not Available 


N 


Page 
Mean 


N 


Page 
Mean 


Publication Type 
Books 


12 


119.6 


26 


248.5 


Curriculum Materials 


44 


118.3 


3 


175.7 


Guides 


20 


78.5 


11 


191.3 


Project Descriptions 


86 


108.1 


4 


299.2 


Proceedings 


t5 


149.0 


1 


153.0 


Research Reports 


135 


88.6 


5 


m.B 


Weighted Mean 


322 


103.1 


50 


227.9 


Reweighted Mean 




103.7 




218.9 




Authorship . The results here can be summarized briefly as fol- 
lows. Onet guides that are written by women are significantly longer 
{206 pp.) than those written by men (86 pp.). Two, the page average 
for the (two) anonymously authored books is much lower (28 pp.) than 
the average for books with individuals identified as authors (218 pp.). 
There are no other significant differences. 

Number of equity q r pups . There are no significant differences 
in page length for this category. 

10. Summary of interrelationships among other RIE content analy- 
sis variables . Beyond the seven significant relationships involving 
equity groups described in Section IV F, this section has reviewed 
thirty-one significant interrelationships among other content analysis 
variables. Among the four topics (attitudes, employment, counseling, 
curriculum), there were significant differences in the proportions of 
types of publ IcationSt in sponsors, performers, authorship, number of 
equity groups identified, and average document page length. 

The simple conclusion is that the RIE_ literature for different topics 
can be remarkably different in many substantial ways, e.g., in which 
types of sponsors fund the work, which types of institutions perfonn 
the work, in the types and page lengths of the documents that are 
found, and even in the sex of the authors, and in the breadth of 
equity groups that are described in the documents. 

When the RIE samples are sorted by publication date into three semi- 
decades, we note that there have been significant changes over time 
for many of the variables including: types of publications found, 
types of performers, types of sponsors, availability of copy, sex of 
authors, and numbers of equity groups identified. 

Publication type is the one variable displaying a significant rela- 
tionship with every other variable employed in the content analysis. 
Proportions of types of publications vary by^topic, publication date, 
type of sponsor, type of performer, copy availability, authorship, 
and nurriber of groups identified. There are also significant page 
length differences among publication types. 

Who sponsors and who performs the work are significant variables that 
interact with each other as well as many other variables including 
topic, date of publication, publication type, copy availability, 
institutional (anonymous) authorship, and average page length. 

When copy availability is examined, we discover that significantly 
larger proportions of the RIE literature are available for documents 
published in the last decade as compared to pre-1970. Although the 
great proportion of RIE documents are available in microfiche [67%) 
or hard copy (77%), copy availability does differ significantly by 
publication type, sponsor type, performer type, anonymous authorship, 
and page length. 

The proportion of anonymously authored documents varies significantly 
by topic, publication type, sponsor, performer, copy availability, 
and page length. The proportion, of male and female first authors 
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differs significantly for topics, over time of publication* and by 
publication type* Sifinlficant page length differences by sex were 
traced to a particular type of publication* 

Although the number of groups identified per document was found to 
vary significantly among the equity groups, this variable displayed 
only three significant relationships with other variables, namely: 
topics, publication date, and publication type* 

Finally, page length is perhaps most fundamentally associated with 
type of publication, with average page length ranging from 22 pages 
for speeches to more than 200 pages for books* However, even when 
adjustments are made by rewelghting publication type means for a 
specific category by the overall proportions of publications types 
found in the entire sample, significant page differences among page 
means are still found among several categories including: topic, 
sponsor, performer, copy availability, and authorship* Given these 
many differences in page length, page estimates for the total RIE 
document literature In particular areas must be made with careful 
attention to what one really wants to estimate* 

Overall, these niany significant relationships point to the need for 
exercising great caution in generalizing from one body of information 
equity literature to another* One can sample and describe the general 
character of specific portions of RIE literature in ways that may be 
infomiative and useful, but one must be cautious In assuming that what 
is found for one equity group may be characteristic of literature for 
other equity groups* 
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APPENDIX A 



HETHODOLOGV 



The anlaysis of the ERIC database in the preliminary study focused on 
the proportion of postings in eight topic areas that pertained to five pop- 
ulation groups. Drawing from the THESAURUS OF ERIC DESCRIPTORS {7th ed.), 
the descriptor terms relevant to each population group were listed* along 
with the number of RIE (Resources in Education) postings to each term. 
Within each group, approximately ten terms were selected—the ten with the 
highest number of postings. Where ten terms did not adequately define the 
population, additional terms were selected. For example, descriptors such 
as Chinese Americans were not among those with large numbers of postings. 
To insure complete representation of all members of the minority group pop- 
ulation, such terms were added. 

The choice of the substantive content areas was guided by the Descrip- 
tor Groups found on page 425 of the THESAURUS. Of the fifty-two Descriptor 
(Groups defined by ERIC, eight were selected. They were chosen as content 
areas with substantial numbers of documents and articles in the ERIC 
database. They were chosen also as topics of relevance to the five 
populations* Selection of the terms used in searching was again guided 
by the number of RIE postings to each term* Those terms with the highest 
number of postings were included until addition of further terms did not 
significantly increase the number of postings for that descriptor group. 
This led to a range of from five to eleven terms per descriptor group, 
associated with a range of from 14,210 to 64,818 postings per descriptor 
group* 

The online search strategy was to create a separate set for each pop- 
ulation group and each content group consisting of the terms selected for 
that group. Each set of population group terms was then combined with 
each set of content terms, using the Boolean "and" operator. Each of 
the resulting forty sets was comprised of all the citations posted to 
at least one of the population terms and one of the content terms within 
the groups being combined. The number of postings in each of the forty 
cells was used to create a five by eight, populations by content areas, 
matrix* Row, column, and marginal percentages were computed on the basis 
of the forty cell postings* 
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ERIC DESCRIPTOR TERMS FOR FIVE SPECIAL POPULATIONS 
EXAMINED IN THE FIRST STUDY 



DISABLED 



17 terms 



physically handicapped 
retarded children 
deaf 

deaf blind 
blind 

handicapped children 
handicaped students 
mentally handicapped 
speech handicapped 
language handicapped 
multiply handicapped 
severely handicapped 
aphasia 

aurally handicapped 
cerebral palsy 
visually handicapped 



MIGRANT 



8 terms 



migrants 

migrant adult education 
migrant education 
migrant child education 
migrant schools 
migrant youth 



MINORITY 



15 terms 



minority groups 
American Indians 
Blacks 

ethnic groups 
Mexican Americans 
Black students 
Puerto Ricans 
Asian Americans 
Eskimos 

bilingual education 
ethnic studies 
cultural pluralism 
Chinese Americans 
Japanese Americans 
Filipino Americans 



RURAL 



10 terms 



rural areas 

agricultural education 
rural urban differences 
rural youth 
rural development 
rural population 
rural extension 
rural schools 
fanners 



WOMEN 



13 terms 



sex differences 
working women 
females 

sex discrimination 
womens education 
mothers 
feminism 
sex role 

sex (characteristics) 
womens studies 
women professors 
women teachers 
women athletics 
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ERIC DESCRIPTOR TERMS FOR EIGHT SUBSTANTIVE AREAS 



ABILITIES 
8 terms 



ADMINISTRATION 
6 terms 



AHITUDES 
7 terms 



ability 

ability grouping 
ability identification 
cognitive ability 
academic ability 
language ability 
skills 

student ability 



administration 
administrative personnel 
administrator role 
administrative organization 
administrative policy 
administrator responsibility 



attitudes 

administrator attitudes 
student attitudes 
teacher attitude 
counselor attitudes 
school attitudes 
coimiunity attitudes 



COUNSELING 
11 terms 



CURRICULUM 
5 terms 



EMPLOYMENT 
8 terms 



counsel ing 
counseling programs 
counseling services 
educational counseling 
occupational guidance 
vocational counseling 
guidance 
counselors 
counselor training 
counseling effectiveness 
career planning 



curriculum 

curriculum development 
curriculum design 



curriculum 
curriculum 



guides 
planning 



employment opportunities 
job training 
personnel evaluation 
unemployment 
employment 
job skills 
labor force 
labor market 



INSTRUCTION 
6 terms 



LEARNING 
6 terms 



instruction 

instructional 

instructional 

instructional 

instructional 

instructional 



learning 
aids learning activities 

design learning processes 
materials learning readiness 
media verbal learning 
tech. visual learning 
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TABLE Al 

RESULTS OF THE FIRST STUDY: 
DATABASE COVERAGE OF EIGHT EDUCATIONAL TOPICS 
WITH REFERENCE TO FIVE GROUPS 





MIGRANTS 

8 terms 
P-1.306 


RURAL 

10 terns 
P-7 .049 


WOMEK 

13 terms 
P-13.719 


OISABLEO 

17 terms 
P-15,771 


MIKORITIES 

15 terms 
P-14.763 


Total 


ABILITY 

8 terns 
P-27.007 


.3* 

Of 

7X 


U 

5% 


3X 

840 

6% 


fix 

1*621 

10% 


41 

946 

6% 


4 Ail £ 

3,846 
14. 3X Of P 


LEARKIKG 

6 terras 
P>34.407 


158 


./I 

256 

41 


673 


2i063 


4X 

1*328 


4.478 
13. U of P 


INSTRUCTIOK 

6 terras 
P>64.818 


218 

16X 


.IX 

636 
-2S ^ 


.9X 

555 

4t 


2.026 

13X 


2*231 . 


5.666 
7.31 of P 


CURRICULUM 

5 terms 
P-35.677 


166 


2X 

676 


IX 

A F 

452 

3X 


3X 

1.025 


4% 

1*603 

m 


3.922 
10.5X of P 


COUNSELING 

11 terms 
P-15.796 


46 

n 


Zi 

336 

51 


6X 

950 

/X 


5X 

808 

5X 


4?& 

« Art 

622 

41 


2.762 
17.31 of P 


AniTUOES 

7 terras 
P>36.6S0 


.4X 

155 ■ 

121 


3X 

981 

MS 


9X 

3.207 

23S 


4X 

1.367 


8X 

2.471 

171 


8.181 
24.41 of P 


ADHIKISTRATIOF 

6 terras 
P-16,330 


.3X 

49 

AX 


345 

5S 


3X 

404 


4X 

649 

41 


3X 

468 

31 


1.870 
12. 3X of P 


ENPLOYMEKT 

8 temts 
P>14»210 


134 

lOX 


6X 

875 


llx 

1.513 

lit 


5X 

695 

41 


8X 

1.059 


4,276 
30 .'9X of P 


Totdl 


1.013 
78« of P 


4.457 


8.594 
621 of P 


10.254 
65* of P 


10.728 
7M of P 


35.001 
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ERIC DESCRIPTOR TERMS USED IN THE FOLLOW UP STUDY 



The terms listed on page A-3 for attitudes, counseling, currtculum, 
and employment were also used in the follow-up study. The search 
terms for the five equity groups are listed below. 



PHYSICALLY HANDICAPPED 
1 tern 

physically handicapped 



MENTALLY HANDICAPPED 
2 terms 

mentally handicapped 
retarded children 



BLACKS 
6 terms 
Blacks 

Black students 
Black youth ^ 
Negroes 

Negro students 
Negro youth 



HISPANICS 
2 terms 

Mexican-American 
Puerto Rican 



WOMEN 

10 terms 

sex differences 
working women 
females 

sex discrimination 
womens education 
mothers 
feminism 
sex role 

sex (characteristics) 
womens studies 
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RIE CONTENT ANALYSIS CATEGORIES 



1. Topics (See search tftrms p. A-3: Attitudes, Counseling, Curri- 
culum, Employinent. ) 

2. Equity Groups {See search terms p. A-5: Physically handicapped. 
Mentally handicapped. Blacks, HispaniCs, Women.) 

3. Publication Semideades (Before 1970,^970-1974; 1975-1979) 

4. Publication Date (last two digits of year of publication) 

5. First Author Location (U.S. States and Territories, District 
of Columbia, Canada, and "Other") 

6. First Author (Performer) Institution Type (University or 
College, Federal Agency, State Agency, Non-profit/ for profit 
Organization, Association, Council or Commission, Publisher, 
Foundation, No information) 

7. Sponsor Type (Federal Agency, Foundation, State or Local 
Educational Agenqy, Other State Agency, Publisher, Other 
(miscellaneous) Sponsor, No information 

8. Copy Availability (Microfiche, 1 if available, 0 otherwise; 
Hardcopy, 1 if available, 0 otherwise) 

9. Authorship (Anonymous author, male first author, female first 
author; one male author, two or more male authors, one male et 
al., male and female, one female, two or more female, one female 
et al.) 

10. Number of Equity Groups Identified. (Based on examination of 
entire RIE entry, code 1 if only one group or class is identi- 
fied, code 2 if two or three different groups or classes are 
identified, code 3 if more than three groups are identified; 
count similar terms only once, e.g.. Mentally Handicapped, 
tducably Mentally Handicapped, Trainable Mentally Handicapped 
would be counted as one group, but if Orthopedically Handi- 
capped also appeared, two groups would be counted. 

The following is a partial listing of terms that were a partial 
that were noted: Age, American Indians, Anglo Americans, Asian 
Americans, Aurally Handicapped, Black (noun). Blacks, Canijdian 
Natives, Cerebral Pals^y, Chicanos, Oeaf, Disadvantaged Youth, 
Educably Mentally Handicapped, Emotionally Disturbed, Eskimos, 
Ethnic Groups, Females, Hospitalized Children, Indochinese, 
Institutionalized (Persons), Japanese, Learning Difficulties, 
Leprosy, Low Income Groups, Lower Class Parents, Mental Illness, 
Migrants, Mothers, Negro (noun), Negroes, Neurologically Handi- 
capped, Orthopedically Handicapped, Physically Handicapped, 
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Puerto Ricans, Racism, Racial Factors, Rotarded Children, Sex, 
Sex (noun). Sexuality, Slow learners. Socially Maladjusted, 
Spanish, Speech Handicapped, Social Class, Social Disadvantage- 
ment. Socioeconomic Background, Rural (noun). Visually Handi- 
capped, Working Women. 

Publication Types. 

A Audio Visual/Nonprint Media; Audiovisual Aids; Films; Tape 
Recordings; Phonotape Recordings; Computer Programs; etc. 

B Books; Monographs; Textbooks; Programmed Texts; etc. (not 
otherwise classifiable) 

C Curricul um Guides; Curriculum Materials; Teacher-Developed 
Materials; Laboratory Manual s 

D Directories; Membership Lists; Table of Organization; 

Reference Works Dealing with Organizations/Institutions; etc. 

G Guides; Teaching Guides; Resource Guides; Study Guides; 
Administrative Guides; Leaders Guides; Manuals; Training 
Manuals 

H Legislation, Legislative Hearings, Legislative Reports, 
Congressional Documents. (Include both Federal and State 
levels; include National Comrnissions) . Court Cases and 
Decisions (all levels). 

0 Journal Articles; Series; Periodicals; Bulletins; News- 
letters; Newspapers; etc. 

K Program/Project Descriptions; Implementation Efforts 

L Bibliographies; Annotated Bibliographies; Book Catalogs; 
Abstracts; Literature Reviews; Literature Searches/Guides; 
Book Lists; Book Reviews; Library Guides; Indexes (Locators); 
State-of-the-Art Reviews 

M Maps; Atlases; Gazetteers 

N Numerical and Statistical Tables; Quantitative Data and Analyses 

0 Other 

P Proceedings; Conference Records/Minutes (entire) 

Q Questionnaires; Tests; Measurement Devices; Evaluation Devices 

R Research Reports; Technical Reports; Studies 

S Speeches; Conference Reports; "Papers presented at Verbal 
Presentations; etc., (not otherwise classifiable) 
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T Theses; Dissertations 

V Dictionaries; Vocabularies; Glossaries; Thesauri 

Y Annual Reports; Yearbooks 



APPENDIX B 



ANALYSIS OF CROSS CLASSIFICATION TABLES 



Although many powerful techniques exist for the analysis of quali- 
tative data {e.g., log-1 inear model s, multi varlate analysis, regres- 
sion analysis), we deliberately confined our exploratory analysis, 
to a simple, three-step process: 

1. examination of the cross classification tables for all 
pairs of content analysis variables, 

2. performing chi square tests on cross classification 
tables that were modified, if necessary, to avoid 
low expected cell frequencies, and 

3. ccxnputing and examining adjusted residuals If the chi 
square test is significant. 

In general we deleted or combined classes to the point where at least 
80 percent of the expected cell frequencies were greater than 5, and 
all remaining were greater than 1. Classes were combined only if 
the combination was logically sensible, and the observed frequencies 
for the two classes were at least roughly proportional. When a signif- 
icant chi square was found, we proceeded to examine the pattern of 
cell residuals. Haberman (Shelby J. Habennan, Analysis of Qual itative 
Data: Volume 1> Introductory Topics . New York, NY: Academic Press, 
1978, p. Ill, p. 121) recommends computing adjusted residuals since 
they have approximate standard normal distributions under tests of 
the models of independence or homogeneity. 

The adjusted residual formula is; 
"ij - "j^/N) 



{n/ n/ [l-(n,^/N)] [l-(n//N)] /h}^^^ 

nn Is the observed frequency for the i-th row 
ana j-th column, 

n^'^ is the marginal total for the i-th row, 

nj^ is the marginal total for the j-th column, 

N is the grand total for the cross classification 
table. 



ARij = 
where 
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The nuinerator In this fonnula Is the (signed) difference between the 
observed and expected cell frequencies* The denominator Is an estimate 
of the variance of this difference* Assuming a multinomial distrib- 
ution and a sufficiently large N (both true for this ERIC content 
analysis 5tiidy)» each adjusted residual is approximately distributed 
as a standard normal variable, with mean zero and variance equal to 
1*0* Although one should be cautious In Interpreting probabilities 
for a single adjusted residual, examination of the set of adjusted 
residuals Is practically useful in detecting the cells where the 
observed frequencies are far greater or smaller than they should be* 

In our analysis we have flagged with asterisks those adjusted residuals 
whose probabilities were less than *05 or *001* We have consistently 
required an *05 level or higher when stating that a significant dif- 
ference exists* 
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APPENDIX C 
ADDITIONAL RIE ANALYSES 



Tho reader may have noted that state location of the first author and 
ERIC clearinghouse information was coded for each RIE_ entry. These 
data were examined but deleted from the text to slightly simplify the 
description of an already extremely tedious analysis. Data on these 
two classification variables are presented in this appendix. 

State location . Table Cl displays the frequency counts for the 
total sample and for each of the five equity group samples by state, 
with states listed In descending order of total frequencies. Since 
previous studies of geographic distribution of ERIC document production 
have shown that state population is highly correlated with ERIC document 
counts, the two right columns of Table Cl give the rank order for the 
RIE total and for the state (1975) population. When we inspect these 
ranks, we see that the District of Columbia is an obvious anomaly since 
it would rank third in the RIE count, but 44th in population. Excluding 
the District of Columbia and the territories, we find that the rank 
order correlation between RIE counts and population for the 50 states 
is .80. Thus, even for RJE documents dealing only with these five 
equity groups and four topics, there is a strong, but far from perfect, 
relation between the population of the state and its contribution to RIE 
equity literature. We have already noted that the District of Columbia 
produces a proportion of the sample of RIE documents that is far out of 
proportion to its population. Indeed onTy the two largest states, 
California and New York, are more productive. As the center of federal 
effort, a headquarters for associations and councils, and a location of 
many non-profit and for-profit agencies, this disproportional ity is 
easily explained. States; whose RIE rankings exceed their population 
rankings by ten or more ranks are: Wisconsin, New Mexico, Arizona, 
Wyoming, Alaska, and Delaware. States whose population rankings exceed 
their Rli rankings by ten or more ranks include: New Jersey, Louisiana, 
Arkansas, and Tennessee. Although inspection of the state data for 
specific equity groups sometimes provides a plausible reason for these 
discrepancies (e.g.. New Mexico and Arizona, as well as California and 
Texas, contribute to the Hispanic literature which might be traced to 
their large Mexican American populations), the sample sizes for most 
states are too small to provide reliable conclusions about specific 
states. 

However, the RIE sample is large enough to permit a regional analysis. 
Table C2 displays the cross tabulation of the ^RIE sample for five 
equity groups and for the four U.S. census regions, the District of 
Columbia, and other (Canada and foreign) regions. The right hand 
column of Table C2 displays the expected values for entries in each 
row. (Since there are 100 cases for each equity group, these entries 
may be read as either observed frequencies or as percentages.) Signifi* 
cant discrepant values have been flagged with asterisks. We see that 
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TABLE CI 

STATE LOCATION OF RIE DOCUMENT 
FIRST AUTHORS FOR TOTAL SAMPLE ANOTOR FIVE EQUITY GROUPS 

















STATE 


STATE 
















RtE 


POP< 




TOTAL 


PH 


MH 


B 


H 


w 


RANK 


RANK 


Kew York 


9S 


21 


17 


2\ 


19 


15 


1 


2 


Cdllfomid 


70 




9 


8 


29 


12 


2 


1 


District of Columbia 


54 


17 


5 


12 


5 


15 






Texas 


33 


1 


2 


10 


19 


1 


A 

3 


A 

3 


Illinois 


22 


4 


B 


1 


3 


6 


4 


5 


Massachusetts 


17 


4 


5 


3 


1 


4 


5 


10 


Wisconsin 


16 


2 


6 


2 


1 


5 


6 


16 


Michigan 


14 


0 


2 


3 


3 


6 


7 


7 


Ohio 


13 


3 


2 


3 


1 


il 
*l 


A 

B 


c 

D 


Maryland 


1 1 


3 


c 


4 


A 

2 


A 
0 


9 




Florida 


9 


2 * 


3 


4 


0 


0 


10.5 


6 


Pennsylvdnf a 


9 


1 


2 


4 


0 


A 

2 


1 A ^ 

10.5 


A 


Georgia 


8 


1 


1 


5 


1 


A 

0 


u 




Korrh Carolina 


7 


0 


2 


1 


A 

0 




14 


1 1 


New Mexico 


7 


1 


0 


1 


3 


2 


14 


A? 

37 


Virginia 


7 


3 


3 


0 


0 


1 


14 


14 

13 


Arizona 


6 


1 


0 


0 


2 


3 


18.5 


A4 

32 


Iowa 


6 


1 


2 


0 


0 


3 


18.5 


Af 

25 


Indiana 


6 


0 


2 


2 


> 


1 


10.5 


Ic 


Minnesota 


6 


0 


c 


3 


1 


A 
0 


fo.5 


19 


Missouri 


6 


2 


3 


0 


0 


1 


18.5 


ie 
15 


Wyoming 


6 


0 


3 


1 


1 


1 


10.5 


JO 

*I9 


Connecticut 


5 


1 


2 


0 


2 


0 


4a 

23 


4il 

24 


Colorado 


5 


2 


1 


1 


1 


0 


4a 

23 


40 

28 


Oregon 


5 


2 


2 


0 


1 


0 


AA 

23 


An 

30 


Alabama 


4 


2 


2 


0 


0 


0 


28 


4 1 

21 


Kentucky 


4 


1 


1 


0 


A 

0 


A 

c 


4a 
CO 


44 


Mississippi 


^ 


0 


0 


3 


A 
0 


\ 
r 


CO 


An 


South Carolina 


4 


2 


1 


0 


0 


1 


40 

28 


4C 

26 


West Virginia 




c 


c 


u 


A 
U 


fl 
u 


CO 


4d 


Kew Jersey 




0 


1 


2 


1 


A 

0 


AQ 

CO 


9 


Washington 




0 


1 


1 


1 


1 


ctf 


99 
cc 


Kansas 




0 


1 


A 

0 


A 
U 


c 




41 


Oklahoma 




0 


1 


U 


u 


c 


Jc *D 


97 


Louisiana 




1 


0 


A 
0 


A 

0 


1 




tu 


Ai aska 


J 


1 


fk 
U 




n 


n 






Delaware 


] 


0 


1 


A 
0 


fl 
U 


fl 
U 






Guam 


] 


|\ 
U 


0 


A 
U 


1 


fl 

u 






Puerto Rico 




0 


A 
0 


A 
0 


( 


fl 

u 






Rhode Island 




0 


1 


0 




0 


36 


39 




V 




A 

V 


"ff ■ 






44 


33 


Hawaii 


0 


0 


0 


0 


0 


0 


44 


40 


Idaho 


0 


0 


0 


0 


0 


0 


44 


41 


Maine 


0 


0 


0 


0 


0 


0 


44 


36 


Montana 


0 


0 


0 


0 


0 


0 


44 


43 


Kebraska 


0 


0 


0 


0 


0 


0 


44 


35 


Nevada 


0 


0 


0 


0 


0 


0 


44 


46 


Kew Hamphire 


0 


0 


0 


0 


0 


0 


44 


42 


North Dakota 


0 


0 


D 


0 


0 


0 


44 


4S 


South Dakota 


0 


0 


0 


0 


0 


0 


44 


44 


Tennessee 


0 


0 


0 


0 


0 


0 


44 


17 


Utha 


0 


0 


0 


0 


0 


0 


44 


36 


Vermont 


0 


0 


0 


0 


0 


0 


44 


48 


Virgin Islands 


0 


0 


0 


0 


0 


0 






Canada 


— 7 


2 


2 


0 


0 


3 






Foreign 


s 


3 


0 


1 


0 


1 






No location 


4 


0 


0 


4 


0 


0 






TOTAL 


500 _ 


_100 


100 


100 


100 


M - 







TABLE C2 

REGIONAL LOCATION OF RIE DOCUMENT 
FIRST AUTHORS FOR FIVE EQUITY GROUPS 
{X2= 58.29; p = .0001) 



CE^tSUS 
REGIONS 


PHVSICALLV 
HANDICAPPEO 


MENTALLV 
HANDICAPPED 


_ BLACKS 


_HISPAK1CS 


WOMEK 


AVERAGE 
(EXPECTEtl) 


NortheAst 


29 


2B 


30 


23 


21 


26.2 


Northctntral 


U 


28** 


14 


10** 


28** 


18.4 


South (* D.C.) 


18 


21 


27 


22 


13** 


20.2 


West 


19 


16 


12** 


38*** 


19 


20.8 


District of 
Colunitta 


17** 


5** 


12 


5** 


15 


10.8 


Other 


5 


2 


5 


2 


4 


3.6 


Tom 


lOO 


100 


100 


100 


100 





the Northeast Census region displays no significant discrepancies, but 
all other regions have one or more* The Northcentral region contrib- 
utes significantly more than expected to the RIE literature for the men- 
tally handicapped and for women, but significantly less than expected 
to the literature for Hispanics* The South has only one discrepancy, 
a lower than expected contribution to the RIE literature on women* The 
West produces significantly less than expected to the literature on 
Blacks, but far more than expected to the literature on Hispanics* 
Finally, the District of Columbia displays three significant discrep- 
ancies* It contributes more than the expected amount to the physi- 
cally handicapped literature* but far less than expected to the liter- 
ature on the mentally handicapped and on Hispanics. 

We thus see that there are significant regional differences in propor^ 
tional contribution to the literature for all five equity groups* 

ERIC Clearinghouse accessions * The data displayed in Tables C3 
and C4 incorporate the CUE data presented in Tables 13 and 14 (pp* 43 
and 45) along with comparable data on RIE accessions. The RIE percent- 
age preceeds the *7" mark with the CIJE percentage following. Clearing- 
houses have been ordered by the All Groups percentages f or gjl acces- 
sions. Turning to Table C3, we first note that there has been some 
reordering of clearinghouses (CHs) as listed in Table 13. CG, which 
had the highest percentage of CIJE accessions, has dropped to fifth 
rank on RIE accessions. EC, which was second for CIJE , has moved to 
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first for RIE . accounting for 23.4 percent of all RIE accessions. 
CE, which was fourth in CUE accessions (9.9%), moves to second place 
with 19.8 percent of all RIE accessions. UD and RC are the third and 
fourth highest, accessing 16.4 percent and 13.6 percent of the RIE 
samples. We note that the RIE_ cumulative percentage for these TTrst 
four CHs (73.2!() just matches the CIJE cumulative percentage for the 
Bghest five CHs (73.4)f. see Table 13); The top five CHs listed in 
Table C3 account for more than 80 percent of the RIE accessions. None 
of the remaining CHs access more than three percent of the RIE, sample. 
And, again, all 16 CHs are represented in the sample; however, SE barely 
made it by contributing just one document to the mentally handicapped/ 
curriculum sample. 

TABLE C3 

percentages of rie docuhents/cije journal articles for each of five groups 

procesWby eric clearinghouses 



ERtC CLEARINGHOUSE 


COOE 


PHYSI- 
CALLY 
HANOI - 
CAPPEO 


HEN- 
TALLY 
HAPTDI- 
CAPPEO 


BLACKS 


HIS- 
PANICS 


WOMEN 


ALL 

GROUPS 


RIE 
TOR 
X 


N-100 
N-e3 


N-TOO 
N-100 


N-100 
N"100 


N-100 
N-100 


N-100 
N-100 


N-500 
N-483 


-RIE N 
-CIJE N 


Hand1capp€<f and 
Gifted Children 


EC 


3g/iix 


76/77X 


1/3X 


0/OX 


1/OX 


23.4/18.4X 


23.4% 


Adult. Career, and 
Vocational Education^ 


CE 


34/23 


14/4 


14/10 


2/5 


35/10 


ig.8/9.g 


43.2 


Urban Education 


DO 


5/0 


VI 


47/32 


24/21 


5/4 


16.4/12.0 


5g.6 


Rural Education and 
Small Schools 


RC 


212 


0/0 


g/1 


4g/27 


8/4 


13.6/7.0 


73.2 


Counsel fn9 and 
Personnel Services 


ca 


8/51 


2/8 


8/21 


4/18 


ig/37 


8,2/26.1 


81.4 


Junior Colleges 


oc 


7/0 


0/0 


2/2 


2/2 


4/2 


3.0/1.2 


84.4 


Languages and 
Linguistics 


Fl 


0/0 


0/0 


1/1 


11/3 


0/3 


2.4/1.4 


86.8 


Social Studies/ Social 
Science Education 


SO 


0/0 


0/0 


3/5 


0/7 


g/2 


2.4/2.g 


89.2 


lieading and Convnunl- 
catlon Skills 


CS 


1/1 


l/I 


3/3 


3/1 


2/5 


2.0/2.3 


91.2 


Higher Education 


HE 


0/1 


0/0 


4/3 


0/3 


6/14 


2.0/4.3 


93.2 


Elementary i Early 
Childhood Education*^ 


PS 


2/0 


2/1 


0/3 


1/1 


3/4 


1.6/l.g 


94.8 


Tests, neasurement, 
and Evaluation 


TH 


0/0 


2/1 


3/2 


1/0 


2/2 


1.6/1.0 


96.4 


Teacher Education 


SP 


1/6 


0/3 


3/1 


1/1 


1/1 


1.2/2.3 


97.6 


Educational HanaOement 


EA 


0/0 


0/0 


1/2 


0/3 


4/1 


1.0/1.? 


98.6 


Information Resources 


IR 


1/1 


0/1 


0/1 


1/1 


1/0 


0.6/0.8 


99.2 


Science, Mathematics, i 
Environmental Education 


SE 


0/0 


1/1 


0/0' 


0/1 


0/3 


0*2/1.0 


99.4 


JliitJssigned or LEASCQ 


AA 


0/4 


1/2 


1/10 


1/6 


r 

0/8 


0.6/6.0 


100.0 


Total 




100 


100 


100 


100 


100 


ioo.o/gg.7 
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When we compare the RIE/CIJE percentages for specific CHs for par- 
ticular groups, we note a number of statistically significant dif- 
ferences. EC provides 39 percent of the £IE documents but only 11 
percent of the C I JE articles to the physically handicapped samples. 
CE provides significantly more documents than journal articles to 
three groups; physically handicapped (34/23), mentally handicapped 
(14/4), and women (35/10). UD also provides significantly more RIE 
documents than CUE articles to the Blacks sample (47/32). RC does 
the sam for Bl^acRs (9/1) and forHispanics (49/27). However, CG 
contributes fewer R I E documents than CUE acticles to all groups, 
and statistically significantly fewer to four of these groups: physi- 
cally handicapped (8/51), Blacks (8/21), Hispanics (4/18), and women 
(19/37). JC, which made no CIJ E contribution to the physically handi- 
capped, accounts for seven percent of the RIE sample for this group. 
FL contributes significantly more RIE than dlJ E items to the Hispanic 
sample (0/7), but significantly more RI£ than CIJE items to the women 
sample (9/2). 

Considered group by group, we note that EC and CE are the major RIE 
contributors to the physically handicapped, while CG is the major 
CIJE contributor for this group. EC accounts for over three- fourth of 
the mentally handicapped samples for both RIE and CUE, but CE and 
RC are second and third for £IE contributions, while" CG and CE are 
second and third for CUE contributions. RC falls just short of 
contributing half (49%) of all RI£ documents in the Hispanic sample, 
while it contributes only a fourth (27%) of the CUE articles to 
this group. CD is the second largest contributor to Hispanics for 
both Rli (24%) and CUE (21%). The surprise in the RI£ analysis is 
that FL, which was tied for 6th place (at 3%) in the CUE analysis, 
is the third largest RIE contributor to Hispanics (11%). CE is the 
largest RIE contributor to women (35%), followed by CG (19%), SO 
(9%), RC"75%), HE (6%), and UD (5%). Overall, the women and the 
Blacks samples show the greatest scatter in CH contribution, while 
the mentally handicapped is the most concentrated. 

Turning now to the counts by topics displayed in Table C4, we again 
note a series of statistically significant differences between RIE and 
CUE contributions by CHs to particular topics. EC is perhaps remark- 
able for the fact that its "across the board" topical coverage (primar- 
ily for the mentally handicapped group) displays approximately the same 
percentages for both RIE/CIJE for each of the four topics. We note that 
CE contributes significantly more Rl£ and CI JE items on employment (39/23) 
and on counseling (19/6). IJD and RC also do the same on counseling (20/5 
and 14/4 respectively). However, CG contributes significantly fewer RIE 
than CIJE items to the counseling samples (14/60), and also to the att i- 
tudes samples (10/20). The only other significant difference is that HE, 
which contributes nine percent of the CUE articles on curriculum, con- 
tributes only two percent of the RIE documents on curriculum (2/9). Over- 
all, perhaps the most significant difference for topics between the RIE 
and the CIJE analysis seems to be the far greater scatter in the RIE 
counseling sample, where five CH contribute between 14 and 22 percent 
each, as contrasted to the case for CU£, where CG alone contributes 
60 percent of all articles on counseling. Thus, in the RIE analysis. 



TABLE C4 



PERCENTAGES OF RIE DOCUMENTS /CUE JOURNAL ARTICLES FOR EACH OF FOUR TOPICS 

PROCESSED BY ERIC CLEARINGHOUSES 



ERIC CLEARINGHOUSE 


CODE 




trirLUTrltli 1 


LUUIi^LL 1 


rMDDf riri i lu 


ALL 

TrtD f 
1 Ur i 


Kit 11* it-> 

7T7E N-1Z5 


Pi" icD 

N-IZS 


N-1Z5 


N-108 


N*483 


Gifted Children 


EC 


Z9/Z1X 


14/1 7X 


ZZ/16X 


30/ZOS 


23.4/18 .4te 


Vocational Education* 


CE 


10/4 


39/23 


19/6 


10/6 


19.8/9.9 


Urban Education 


_UD 


15/14 


15/18 


ZO/5 


15/lZ 


16.4/12.0 


Kurai toucatiOf) and 
Small Schools 


RC 


15/10 


16/8 


14/4 


10/6 


13.6/7.0 


LvUn5€ 1 1 n9 BflU 

Personnel Services 


CG 


10/ZO 


4/18 


14/60 


4/3 


8.2/26.1 


Junior Colleo&s 


JC 


4/1 


3/0 


3/0 


Z/5 


3.0/1.2 


Lonyua^es ano 
Linguistics 


FL 


2/2 


0/1 


1/0 


7/4 


2.4/1.4 


Social Studies/Social 




2/4 

1/4 


_kIA 






9 A/9 Q 


Reading and Communi- 
cation Skills 


CS 


3/5 


Z/1 


0/1 


Z/3 


2.0/2 .3 


Higher Education 


HE 


0/0 


Z/6 


3/Z 


2/9 


2.0/4.3 


Elementary A Early 
Childhood Education** 


PS 


Z/5 


0/0 


Z/1 


2J2 


1.6/1.9 


Tests, Measurement^ 
and Evaluation 


TM 


3/3 


0/0 


1/0 


2i\ 


1.6/1.0 


Teacher Education 


SP 


2/2 


0/Z 


0/1 


2/S 


1.2/2.3 


Educational Management 


EA 


0/1 


z/z 


0/0 


2/2 


1.0/1.2 


Information Resources 


IR 


0/1 


0/1 


0/0 


2/2 


0.6/0.8 


Science, Mathentatlcs^ St 
Environmental Education 


SE 


0/2 


0/0 


0/0 


1/3 


0.2/1.0 


Not Assigned or LEASCO 


AA 


1/8 


0/Z 


Z/4 


0/10 


0.6/6.0 


TOTAL 




98/103 


99/101 


101/100 


99/100 


100.0/99.7 
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